Apr 12 15:52:56 user devstack@n-api.service[61656]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 12 15:52:56 user devstack@n-api.service[61656]: *** Starting uWSGI 2.0.20-debian (64bit) on [Wed Apr 12 15:52:56 2023] *** Apr 12 15:52:56 user devstack@n-api.service[61656]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 12 15:52:56 user devstack@n-api.service[61656]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 12 15:52:56 user devstack@n-api.service[61656]: nodename: user Apr 12 15:52:56 user devstack@n-api.service[61656]: machine: x86_64 Apr 12 15:52:56 user devstack@n-api.service[61656]: clock source: unix Apr 12 15:52:56 user devstack@n-api.service[61656]: pcre jit disabled Apr 12 15:52:56 user devstack@n-api.service[61656]: detected number of CPU cores: 12 Apr 12 15:52:56 user devstack@n-api.service[61656]: current working directory: / Apr 12 15:52:56 user devstack@n-api.service[61656]: detected binary path: /usr/bin/uwsgi-core Apr 12 15:52:56 user devstack@n-api.service[61656]: your processes number limit is 63637 Apr 12 15:52:56 user devstack@n-api.service[61656]: your memory page size is 4096 bytes Apr 12 15:52:56 user devstack@n-api.service[61656]: detected max file descriptor number: 2048 Apr 12 15:52:56 user devstack@n-api.service[61656]: lock engine: pthread robust mutexes Apr 12 15:52:56 user devstack@n-api.service[61656]: thunder lock: enabled Apr 12 15:52:56 user devstack@n-api.service[61656]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 12 15:52:56 user devstack@n-api.service[61656]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 12 15:52:56 user devstack@n-api.service[61656]: Python main interpreter initialized at 0x556b1fab9990 Apr 12 15:52:56 user devstack@n-api.service[61656]: python threads support enabled Apr 12 15:52:56 user devstack@n-api.service[61656]: your server socket listen backlog is limited to 100 connections Apr 12 15:52:56 user devstack@n-api.service[61656]: your mercy for graceful operations on workers is 90 seconds Apr 12 15:52:56 user devstack@n-api.service[61656]: mapped 537436 bytes (524 KB) for 3 cores Apr 12 15:52:56 user devstack@n-api.service[61656]: *** Operational MODE: preforking *** Apr 12 15:52:56 user devstack@n-api.service[61656]: *** uWSGI is running in multiple interpreter mode *** Apr 12 15:52:56 user devstack@n-api.service[61656]: spawned uWSGI master process (pid: 61656) Apr 12 15:52:56 user devstack@n-api.service[61656]: spawned uWSGI worker 1 (pid: 61657, cores: 1) Apr 12 15:52:56 user devstack@n-api.service[61656]: spawned uWSGI worker 2 (pid: 61658, cores: 1) Apr 12 15:52:56 user devstack@n-api.service[61656]: spawned uWSGI worker 3 (pid: 61659, cores: 1) Apr 12 15:52:56 user devstack@n-api.service[61656]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 12 15:52:57 user devstack@n-api.service[61659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 15:52:57 user devstack@n-api.service[61657]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 15:52:57 user devstack@n-api.service[61658]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 15:53:00 user devstack@n-api.service[61657]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 15:53:00 user devstack@n-api.service[61657]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 15:53:00 user devstack@n-api.service[61657]: and ``live_migration_inbound_addr`` respectively. Apr 12 15:53:00 user devstack@n-api.service[61657]: ). Its value may be silently ignored in the future. Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 15:53:00 user devstack@n-api.service[61658]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 15:53:00 user devstack@n-api.service[61658]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 15:53:00 user devstack@n-api.service[61658]: and ``live_migration_inbound_addr`` respectively. Apr 12 15:53:00 user devstack@n-api.service[61658]: ). Its value may be silently ignored in the future. Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 12 15:53:00 user devstack@n-api.service[61659]: live_migration_uri is deprecated for removal in favor of two other options that Apr 12 15:53:00 user devstack@n-api.service[61659]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 12 15:53:00 user devstack@n-api.service[61659]: and ``live_migration_inbound_addr`` respectively. Apr 12 15:53:00 user devstack@n-api.service[61659]: ). Its value may be silently ignored in the future. Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61657) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61658) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61659) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 12 15:53:00 user devstack@n-api.service[61657]: INFO dbcounter [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Registered counter for database nova_api Apr 12 15:53:00 user devstack@n-api.service[61658]: INFO dbcounter [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Registered counter for database nova_api Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_db.sqlalchemy.engines [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61657) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_db.sqlalchemy.engines [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61658) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:00 user devstack@n-api.service[61659]: INFO dbcounter [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Registered counter for database nova_api Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writer thread running {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writer thread running {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61659) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writer thread running {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG nova.context [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbea3ab3-8640-46e2-9e3e-8e9284315861(cell1) {{(pid=61657) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG nova.context [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbea3ab3-8640-46e2-9e3e-8e9284315861(cell1) {{(pid=61658) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:53:00 user devstack@n-api.service[61657]: INFO dbcounter [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Registered counter for database nova_cell0 Apr 12 15:53:00 user devstack@n-api.service[61658]: INFO dbcounter [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Registered counter for database nova_cell0 Apr 12 15:53:00 user devstack@n-api.service[61658]: INFO dbcounter [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Registered counter for database nova_cell1 Apr 12 15:53:00 user devstack@n-api.service[61657]: INFO dbcounter [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Registered counter for database nova_cell1 Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG nova.context [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),dbea3ab3-8640-46e2-9e3e-8e9284315861(cell1) {{(pid=61659) load_cells /opt/stack/nova/nova/context.py:464}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_db.sqlalchemy.engines [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61658) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG oslo_db.sqlalchemy.engines [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61657) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writer thread running {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:53:00 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writer thread running {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:53:00 user devstack@n-api.service[61658]: DEBUG oslo_db.sqlalchemy.engines [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61658) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:00 user devstack@n-api.service[61659]: INFO dbcounter [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Registered counter for database nova_cell0 Apr 12 15:53:00 user devstack@n-api.service[61659]: INFO dbcounter [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Registered counter for database nova_cell1 Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61659) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writer thread running {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:00 user devstack@n-api.service[61659]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61659) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:01 user devstack@n-api.service[61657]: DEBUG oslo_db.sqlalchemy.engines [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61657) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:01 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writer thread running {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:01 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writer thread running {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:01 user devstack@n-api.service[61658]: INFO dbcounter [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Registered counter for database nova_cell0 Apr 12 15:53:01 user devstack@n-api.service[61657]: INFO dbcounter [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Registered counter for database nova_cell0 Apr 12 15:53:01 user devstack@n-api.service[61658]: DEBUG oslo_db.sqlalchemy.engines [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61658) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:01 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writer thread running {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:01 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writer thread running {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:01 user devstack@n-api.service[61657]: DEBUG oslo_db.sqlalchemy.engines [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61657) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:01 user devstack@n-api.service[61659]: INFO dbcounter [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Registered counter for database nova_cell0 Apr 12 15:53:01 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writer thread running {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:01 user devstack@n-api.service[61659]: DEBUG oslo_db.sqlalchemy.engines [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61659) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 12 15:53:01 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writer thread running {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 12 15:53:01 user devstack@n-api.service[61659]: WARNING keystonemiddleware.auth_token [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 15:53:01 user devstack@n-api.service[61657]: WARNING keystonemiddleware.auth_token [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 15:53:01 user devstack@n-api.service[61658]: WARNING keystonemiddleware.auth_token [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 15:53:01 user devstack@n-api.service[61659]: WARNING keystonemiddleware.auth_token [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 15:53:01 user devstack@n-api.service[61657]: WARNING keystonemiddleware.auth_token [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 15:53:01 user devstack@n-api.service[61658]: WARNING keystonemiddleware.auth_token [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 15:53:01 user devstack@n-api.service[61657]: WARNING keystonemiddleware.auth_token [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 15:53:01 user devstack@n-api.service[61658]: WARNING keystonemiddleware.auth_token [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 15:53:01 user devstack@n-api.service[61659]: WARNING keystonemiddleware.auth_token [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 12 15:53:01 user devstack@n-api.service[61657]: WARNING keystonemiddleware.auth_token [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 15:53:01 user devstack@n-api.service[61658]: WARNING keystonemiddleware.auth_token [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 15:53:01 user devstack@n-api.service[61659]: WARNING keystonemiddleware.auth_token [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 12 15:53:01 user devstack@n-api.service[61657]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b1fab9990 pid: 61657 (default app) Apr 12 15:53:01 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:53:01 user devstack@n-api.service[61658]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b1fab9990 pid: 61658 (default app) Apr 12 15:53:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3acb7059-d029-403d-85fd-24eba156fe4b None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001488 Apr 12 15:53:01 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Wed Apr 12 15:53:01 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:53:01 user devstack@n-api.service[61659]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556b1fab9990 pid: 61659 (default app) Apr 12 15:55:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-0b97a23b-dc67-47f8-ae71-cdff5d2cd75f None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001890 Apr 12 15:55:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 1/2] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:11 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:11 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:11 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:11 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:11 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-28caa0e6-b22e-4679-a78f-6bd632b26a17 admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-28caa0e6-b22e-4679-a78f-6bd632b26a17 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.395094 Apr 12 15:55:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 2/3] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 15:55:11 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001940 Apr 12 15:55:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:13 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-be25e2a5-a570-4e11-935e-228489304e4b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1", "os-flavor-access:is_public": true, "vcpus": 1, "ram": 256}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-be25e2a5-a570-4e11-935e-228489304e4b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.319500 Apr 12 15:55:14 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 2/5] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:13 2023] POST /compute/v2.1/flavors => generated 405 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fa0b021d-c9b2-4173-9e63-e28047ecb8c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fa0b021d-c9b2-4173-9e63-e28047ecb8c8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052290 Apr 12 15:55:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 3/6] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 15:55:14 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001353 Apr 12 15:55:16 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-10be385e-e5ec-4ce1-a304-e7add42003af admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-10be385e-e5ec-4ce1-a304-e7add42003af admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064350 Apr 12 15:55:16 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 3/8] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:16 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 15:55:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3703c362-b48a-455b-924b-644f79e8aff8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3703c362-b48a-455b-924b-644f79e8aff8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030083 Apr 12 15:55:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 4/9] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 15:55:16 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001740 Apr 12 15:55:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:18 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:18 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-362b854c-ed3c-46d7-a96a-e4ec78dd4fad admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 10, "id": "d2", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G", "ram": 1024}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-362b854c-ed3c-46d7-a96a-e4ec78dd4fad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.103982 Apr 12 15:55:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 4/11] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:18 2023] POST /compute/v2.1/flavors => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-94f03c8b-f77a-4453-94ea-b5ff939d309e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-94f03c8b-f77a-4453-94ea-b5ff939d309e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024226 Apr 12 15:55:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 5/12] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 15:55:18 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001775 Apr 12 15:55:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:20 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ddeef09c-ab20-4d4a-9bf4-de5d191a4aa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "disk": 10, "id": "d3", "vcpus": 2}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-ddeef09c-ab20-4d4a-9bf4-de5d191a4aa0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065996 Apr 12 15:55:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 5/14] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:20 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1bc83007-bfa1-4384-b226-ffc0396bfdea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1bc83007-bfa1-4384-b226-ffc0396bfdea admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024296 Apr 12 15:55:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 6/15] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 15:55:20 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001602 Apr 12 15:55:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:22 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b2736535-52a6-4dc5-aa1e-6d3a5772d0f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "disk": 20, "name": "ds4G", "vcpus": 4, "ram": 4096, "swap": 0}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b2736535-52a6-4dc5-aa1e-6d3a5772d0f8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061032 Apr 12 15:55:22 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 6/17] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:22 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025609 Apr 12 15:55:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 7/18] 10.0.0.210 () {64 vars in 1329 bytes} [Wed Apr 12 15:55:22 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7f4bdef4-2185-42d6-86af-22fbdbb0a713 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001585 Apr 12 15:55:24 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:24 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e7b195e1-e7f1-4391-80df-4abbb1d46d49 admin admin] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e7b195e1-e7f1-4391-80df-4abbb1d46d49 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.072750 Apr 12 15:55:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 7/20] 10.0.0.210 () {60 vars in 1285 bytes} [Wed Apr 12 15:55:24 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:55:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001569 Apr 12 15:55:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 8/21] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:26 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:55:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:55:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-4adb106e-2087-455b-a88a-17db64e1a7ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "disk": 1}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-4adb106e-2087-455b-a88a-17db64e1a7ac admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.470311 Apr 12 15:55:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:26 2023] POST /compute/v2.1/flavors => generated 400 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3210198c-6e92-4378-ba5e-198e97ff9e51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-3210198c-6e92-4378-ba5e-198e97ff9e51 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045602 Apr 12 15:55:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 8/23] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 15:55:26 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001319 Apr 12 15:55:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 9/24] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8e16d137-3c3e-495e-9866-28187faca22c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "ram": 2048, "swap": 0}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8e16d137-3c3e-495e-9866-28187faca22c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.058236 Apr 12 15:55:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:29 2023] POST /compute/v2.1/flavors => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a121f2b6-2403-4a51-8996-5a0551d787b4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-a121f2b6-2403-4a51-8996-5a0551d787b4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027385 Apr 12 15:55:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 9/26] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 15:55:29 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:31 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002294 Apr 12 15:55:31 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 10/27] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:31 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:31 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-97c228fa-9922-4bc3-b7ff-e43b6e936026 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:31 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-97c228fa-9922-4bc3-b7ff-e43b6e936026 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067846 Apr 12 15:55:31 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:31 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:31 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-dcc1c2a8-e1e9-408e-9ca1-84db3a74cf15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:31 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-dcc1c2a8-e1e9-408e-9ca1-84db3a74cf15 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026059 Apr 12 15:55:31 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 10/29] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 15:55:31 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:33 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:33 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001518 Apr 12 15:55:33 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 11/30] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-920e3f31-69f9-4272-bb9e-c5a37e98d290 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "vcpus": 4}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-920e3f31-69f9-4272-bb9e-c5a37e98d290 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061534 Apr 12 15:55:33 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:33 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:33 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1f556c2c-bfce-48e9-81d7-4e9e432e411a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1f556c2c-bfce-48e9-81d7-4e9e432e411a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025412 Apr 12 15:55:33 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 11/32] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 15:55:33 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:55:35 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:55:35 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001810 Apr 12 15:55:35 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 12/33] 10.0.0.210 () {54 vars in 924 bytes} [Wed Apr 12 15:55:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:55:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a14112d7-31e1-435e-b3d8-558302d17223 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:35 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a14112d7-31e1-435e-b3d8-558302d17223 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.059770 Apr 12 15:55:35 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Wed Apr 12 15:55:35 2023] POST /compute/v2.1/flavors => generated 406 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:55:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-330a2e51-6173-4312-8a83-15e19dbba6a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:55:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-330a2e51-6173-4312-8a83-15e19dbba6a7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027228 Apr 12 15:55:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 12/35] 10.0.0.210 () {64 vars in 1326 bytes} [Wed Apr 12 15:55:35 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:56:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:56:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-27d8965c-9b39-4e17-935b-95beb0a694af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001432 Apr 12 15:56:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 13/36] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 15:56:06 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:56:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:56:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.088284 Apr 12 15:56:06 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Wed Apr 12 15:56:06 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:56:38 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-330a2e51-6173-4312-8a83-15e19dbba6a7 admin admin] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:56:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-330a2e51-6173-4312-8a83-15e19dbba6a7 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001602 Apr 12 15:56:38 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 13/38] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 15:56:38 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:56:38 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:56:38 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5089a119-0536-435e-89c7-2d9d789cd724 admin admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:56:38 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5089a119-0536-435e-89c7-2d9d789cd724 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.084859 Apr 12 15:56:38 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 14/39] 10.0.0.210 () {64 vars in 1367 bytes} [Wed Apr 12 15:56:38 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:56:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:56:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001661 Apr 12 15:56:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 15:56:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:56:42 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:56:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4b861cb6-5dbe-4df8-a450-38ae59b3e5b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "id": "42", "ram": 128, "name": "m1.nano", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:56:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4b861cb6-5dbe-4df8-a450-38ae59b3e5b7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.068805 Apr 12 15:56:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 14/41] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 15:56:42 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:56:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c403814d-942e-49e1-9e86-3d6cb62e7ef9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:56:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c403814d-942e-49e1-9e86-3d6cb62e7ef9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027649 Apr 12 15:56:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 15/42] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 15:56:42 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:56:46 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:56:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6a605463-b8f2-4702-9b13-4bba3c4c4ec2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001770 Apr 12 15:56:46 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Wed Apr 12 15:56:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:56:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f6d84b0d-7600-4999-8e2b-3f30e412f818 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "84", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "name": "m1.micro", "ram": 192}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:56:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f6d84b0d-7600-4999-8e2b-3f30e412f818 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.064335 Apr 12 15:56:46 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 15/44] 10.0.0.210 () {68 vars in 1358 bytes} [Wed Apr 12 15:56:46 2023] POST /compute/v2.1/flavors => generated 404 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 15:56:46 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-805ddb2e-7d8a-407c-91fc-f682af1e6f4a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:56:46 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-805ddb2e-7d8a-407c-91fc-f682af1e6f4a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027693 Apr 12 15:56:46 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 16/45] 10.0.0.210 () {68 vars in 1411 bytes} [Wed Apr 12 15:56:46 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:58:59 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:58:59 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:58:59 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7c5417c1-c0a7-42eb-b388-2dd5c922860e tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Action: 'create', calling method: .version_select at 0x7fdee879f250>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-254227402", "metadata": {"Type": "work"}}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7c5417c1-c0a7-42eb-b388-2dd5c922860e tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.397228 Apr 12 15:59:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 15:58:59 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 1400 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 15:59:01 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:01 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-223b91a7-383d-43a0-8379-0add258d1119 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee879d750>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-223b91a7-383d-43a0-8379-0add258d1119 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 200 len: 352 microversion: 2.1 time: 0.266778 Apr 12 15:59:01 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 16/47] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:01 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 352 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:02 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:02 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-6b2d5122-9986-4b17-bc42-fa9ccd146c0c tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee88fe440>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-6b2d5122-9986-4b17-bc42-fa9ccd146c0c tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 200 len: 353 microversion: 2.1 time: 0.267233 Apr 12 15:59:02 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 17/48] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:02 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:02 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-fe16e885-ba12-4863-af24-354a2437f8df tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee8620820>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-fe16e885-ba12-4863-af24-354a2437f8df tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 200 len: 353 microversion: 2.1 time: 0.129819 Apr 12 15:59:02 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:02 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:02 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-23c9589d-c2ba-42c2-87e3-b631f15b5c50 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee862bac0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:02 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-23c9589d-c2ba-42c2-87e3-b631f15b5c50 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 202 len: 0 microversion: 2.1 time: 0.096129 Apr 12 15:59:02 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 15:59:02 2023] DELETE /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 15:59:02 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-07bd066a-bad3-425f-903b-882909696498 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee86236d0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-07bd066a-bad3-425f-903b-882909696498 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 200 len: 352 microversion: 2.1 time: 0.051516 Apr 12 15:59:02 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 18/51] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:02 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:03 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d3771de1-58d8-4008-a601-f9e78c21a8ba tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee8620940>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d3771de1-58d8-4008-a601-f9e78c21a8ba tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 200 len: 352 microversion: 2.1 time: 0.048923 Apr 12 15:59:04 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:03 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:05 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6824a0a5-59d6-4e81-99b6-cadc0a20d908 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee86441f0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6824a0a5-59d6-4e81-99b6-cadc0a20d908 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 200 len: 352 microversion: 2.1 time: 0.064155 Apr 12 15:59:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 18/53] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:05 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 352 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fb657f71-fe3c-48de-adc0-d641038cdf9d tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee8623d90>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fb657f71-fe3c-48de-adc0-d641038cdf9d tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 200 len: 352 microversion: 2.1 time: 0.054637 Apr 12 15:59:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 19/54] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:06 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-96f71f83-0efe-42a2-93e1-c63bd6f308e9 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Calling method '.version_select at 0x7fdee8620f70>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-96f71f83-0efe-42a2-93e1-c63bd6f308e9 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] HTTP exception thrown: Volume e536c597-dba6-4793-bf28-a73e17b94b2f could not be found. Apr 12 15:59:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-96f71f83-0efe-42a2-93e1-c63bd6f308e9 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Request method failure captured: Apr 12 15:59:07 user devstack@n-api.service[61659]: request: GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f HTTP/1.1 Apr 12 15:59:07 user devstack@n-api.service[61659]: Accept: application/json Apr 12 15:59:07 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 15:59:07 user devstack@n-api.service[61659]: Connection: close Apr 12 15:59:07 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 15:59:07 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 15:59:07 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 15:59:07 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 15:59:07 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVDELV7ZLY4AkDCPRSvPujfdov1s4nL_46yXRREN9FOJdUTxAH5gfN2LCsVSU-6D-2_opkXZZbV8u1na1Vpvysy4bsiaXB77VDGqJ_bxfDWNvPTrrf1I-8sLKbbvCOPLma_iwckMtOs__MiY0edcsmyU2L2AwKf6BeBuBDXY2qFTB0 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Project-Id: d61f6992365542aeaa47f5e3a2c02fc3 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesGetTestJSON-2005536943 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d61f6992365542aeaa47f5e3a2c02fc3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d61f6992365542aeaa47f5e3a2c02fc3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d61f6992365542aeaa47f5e3a2c02fc3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesGetTestJSON-2005536943 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Tenant-Id: d61f6992365542aeaa47f5e3a2c02fc3 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesGetTestJSON-2005536943 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-User: tempest-VolumesGetTestJSON-2005536943-project-member Apr 12 15:59:07 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 15:59:07 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 15:59:07 user devstack@n-api.service[61659]: X-User-Id: 530940b60e604b61b03a5e4496dcd2a4 Apr 12 15:59:07 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesGetTestJSON-2005536943-project-member Apr 12 15:59:07 user devstack@n-api.service[61659]: method: Apr 12 15:59:07 user devstack@n-api.service[61659]: exception: Volume e536c597-dba6-4793-bf28-a73e17b94b2f could not be found. Apr 12 15:59:07 user devstack@n-api.service[61659]: action_args: {'id': 'e536c597-dba6-4793-bf28-a73e17b94b2f'} Apr 12 15:59:07 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e536c597-dba6-4793-bf28-a73e17b94b2f could not be found. (HTTP 404) (Request-ID: req-c5f30e89-1089-4b9c-8fc0-8ef8b3f6cfca) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e536c597-dba6-4793-bf28-a73e17b94b2f could not be found. Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e536c597-dba6-4793-bf28-a73e17b94b2f could not be found. Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e536c597-dba6-4793-bf28-a73e17b94b2f could not be found. Apr 12 15:59:07 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 15:59:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-96f71f83-0efe-42a2-93e1-c63bd6f308e9 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] Returning 404 to user: Volume e536c597-dba6-4793-bf28-a73e17b94b2f could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 15:59:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-96f71f83-0efe-42a2-93e1-c63bd6f308e9 tempest-VolumesGetTestJSON-2005536943 tempest-VolumesGetTestJSON-2005536943-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f" status: 404 len: 109 microversion: 2.1 time: 0.041015 Apr 12 15:59:07 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 15:59:07 2023] GET /compute/v2.1/os-volumes/e536c597-dba6-4793-bf28-a73e17b94b2f => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 15:59:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1230796191", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:16 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] validate_networks() for [('06fae0be-02dd-4962-a1ac-fd0413772758', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for user 880266e3fa4d4dd889648c10208a1f8e and project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:18 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-a07c7925-cadc-4133-8820-43d94fea3323 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.786845 Apr 12 15:59:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 15:59:16 2023] POST /compute/v2.1/servers => generated 381 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 15:59:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-37dc2eb2-85d1-461f-829c-d6faca415d63 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:18 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-37dc2eb2-85d1-461f-829c-d6faca415d63 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:18 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-37dc2eb2-85d1-461f-829c-d6faca415d63 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-37dc2eb2-85d1-461f-829c-d6faca415d63 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 200 len: 1216 microversion: 2.1 time: 0.182947 Apr 12 15:59:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 20/57] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 15:59:18 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 1216 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:59:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-908306689", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:18 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] validate_networks() for [('06fae0be-02dd-4962-a1ac-fd0413772758', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-73a323fb-14a9-4a28-b8ca-c9e3901ab17a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'create', calling method: .version_select at 0x7fdee86f9ab0>, body: {"keypair": {"name": "tempest-keypair-1362669684", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP/Xq604Ni9GyIbrWoJD7InG3g/r5BKu6klFR/hZ1bKdq3Hy1Mk7Pe+nAKjrfzX5p0VIQ/uMvcVFsrX06k2D5Iq1KlW5EZ6pMRc39ATodyZ/r0xBGzk9bUr1v/CNzPJ0EQ=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:19 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-73a323fb-14a9-4a28-b8ca-c9e3901ab17a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:19 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-73a323fb-14a9-4a28-b8ca-c9e3901ab17a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for user c1abec24caf74dc8a27b64c21a9d4a59 and project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:19 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-73a323fb-14a9-4a28-b8ca-c9e3901ab17a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.269686 Apr 12 15:59:19 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 20/58] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 15:59:19 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 272 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 15:59:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1280952745", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "b36306e0-04c5-4b1b-8022-05ff121c4e43"}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:20 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] validate_networks() for [('b36306e0-04c5-4b1b-8022-05ff121c4e43', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for user 880266e3fa4d4dd889648c10208a1f8e and project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d8b1b83d-8e2f-4d43-b639-9cf3663f6a65 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.671271 Apr 12 15:59:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 19/59] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 15:59:18 2023] POST /compute/v2.1/servers => generated 381 bytes in 2673 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 15:59:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c36397df-b81d-4763-b8ef-67b19370ac35 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:21 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c36397df-b81d-4763-b8ef-67b19370ac35 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:21 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c36397df-b81d-4763-b8ef-67b19370ac35 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c36397df-b81d-4763-b8ef-67b19370ac35 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872" status: 200 len: 1215 microversion: 2.1 time: 0.367934 Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 21/60] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 15:59:21 2023] GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 => generated 1215 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for user 73f9fa5bc22a4824b3cdcb8cf7bb380c and project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:21 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-de4d3742-7901-4946-86ff-3e9c2a36ac58 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.742892 Apr 12 15:59:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 21/61] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 15:59:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 1744 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 15:59:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-09674d2e-78d9-4dd2-b8af-eab1c7d57e57 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:22 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-09674d2e-78d9-4dd2-b8af-eab1c7d57e57 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-09674d2e-78d9-4dd2-b8af-eab1c7d57e57 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-09674d2e-78d9-4dd2-b8af-eab1c7d57e57 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-09674d2e-78d9-4dd2-b8af-eab1c7d57e57 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-09674d2e-78d9-4dd2-b8af-eab1c7d57e57 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001" status: 200 len: 1395 microversion: 2.87 time: 0.414787 Apr 12 15:59:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 20/62] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 15:59:22 2023] GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => generated 1395 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:59:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ae2bf8c9-685a-47bc-8942-fcdb653f4807 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'create', calling method: .version_select at 0x7fdee7d3c1f0>, body: {"keypair": {"name": "tempest-keypair-1923467613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNmXVADjvoPSh3uGCGCTNS/vcfcDtUjn/vZEaV3bCllfz1ZO8VIgFuZhP+mAsa+G/KA4ubi5U9Vj41YtHGsakdPR5VoByhorvfUv/PIWtER2tn1LWX2mlFyT+T8AEJplPw=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:22 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-ae2bf8c9-685a-47bc-8942-fcdb653f4807 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for project 97ea81bd1962466bbe552424973f71a8. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:22 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-ae2bf8c9-685a-47bc-8942-fcdb653f4807 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for user 1a699b3ba8304eadb8a53d465ea340cf and project 97ea81bd1962466bbe552424973f71a8. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-ae2bf8c9-685a-47bc-8942-fcdb653f4807 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.255988 Apr 12 15:59:23 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 22/63] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 15:59:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:27 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1390712116", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e6694358-e361-4952-b859-93755c11721e"}], "security_groups": [{"name": "tempest-securitygroup--384785848"}], "key_name": "tempest-keypair-1923467613", "user_data": "}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:28 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] validate_networks() for [('e6694358-e361-4952-b859-93755c11721e', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Creating event network-changed:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4bf47603-8f9f-424f-9497-0d9c9c2165b7 req-a31f7e26-9f8f-450f-9e65-a6d5fff244fc service nova] Acquired lock "compute-rpcapi-router" {{(pid=61659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:28 user devstack@n-api.service[61659]: INFO nova.compute.rpcapi [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 15:59:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61659) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 15:59:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5a0dec51-14dd-4aa0-b10b-da4b25ba80c8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179462 Apr 12 15:59:28 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 21/64] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:28 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-791161427", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f"}], "security_groups": [{"name": "tempest-securitygroup--1121338461"}], "key_name": "tempest-keypair-1362669684", "user_data": "}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:28 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:28 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:28 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] validate_networks() for [('eb4dd4b5-96d4-4b53-b510-d41e2775b92f', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for user 1a699b3ba8304eadb8a53d465ea340cf and project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:29 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-878f65b4-ca24-4534-a673-60e2a3e09283 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.295934 Apr 12 15:59:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 22/65] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 15:59:27 2023] POST /compute/v2.1/servers => generated 406 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 15:59:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-01dd3152-bdb7-470a-ac6b-886fcd2716c4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:29 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-01dd3152-bdb7-470a-ac6b-886fcd2716c4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:29 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-01dd3152-bdb7-470a-ac6b-886fcd2716c4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-01dd3152-bdb7-470a-ac6b-886fcd2716c4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1233 microversion: 2.1 time: 0.243515 Apr 12 15:59:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 15:59:29 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1233 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for user c1abec24caf74dc8a27b64c21a9d4a59 and project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:29 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-67f42bed-1688-4a3a-8778-9347e686bc33 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.322308 Apr 12 15:59:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 23/67] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 15:59:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 15:59:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6396a5b8-f03a-49a0-8cef-0f5445d78a05 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:29 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6396a5b8-f03a-49a0-8cef-0f5445d78a05 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:30 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-69ba58a7-cf12-4051-b46e-dcbf759115d1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: .version_select at 0x7fdee8529480>, body: {"keypair": {"name": "tempest-keypair-774364981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKL8mRKoQBwSpXabs7lbNBcQQ+v0lDGL36wi/OpmOmwBfUVFldN2KTVLXYYnjIUA6HtcnsAqIEqMv/Fg1gZorrfhXrwT58AUeYmBczJa1dUqudRokgSOxtQEOgjrUHlOaQ=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:30 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-69ba58a7-cf12-4051-b46e-dcbf759115d1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:30 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-69ba58a7-cf12-4051-b46e-dcbf759115d1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:30 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-6396a5b8-f03a-49a0-8cef-0f5445d78a05 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:30 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-6396a5b8-f03a-49a0-8cef-0f5445d78a05 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:30 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-6396a5b8-f03a-49a0-8cef-0f5445d78a05 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6396a5b8-f03a-49a0-8cef-0f5445d78a05 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 200 len: 1275 microversion: 2.20 time: 0.173877 Apr 12 15:59:30 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 23/68] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 15:59:29 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:59:30 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-69ba58a7-cf12-4051-b46e-dcbf759115d1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.309541 Apr 12 15:59:30 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 15:59:29 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:30 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Creating event network-changed:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61658) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b3a943de-97b4-4f61-a056-d7830da84616 req-73873cdd-1c80-4dbd-a4b5-52494f23eb63 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61658) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:30 user devstack@n-api.service[61658]: INFO nova.compute.rpcapi [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 15:59:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] Releasing lock "compute-rpcapi-router" {{(pid=61658) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 15:59:30 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1147012d-52fe-43f8-b6ad-d51f960381cd None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142562 Apr 12 15:59:30 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:32 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "608fbea2-b42b-4bb9-94a7-2b76dcdc2001", "tag": "246d47a5-6953-4e38-8546-63953a8721cf"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] Creating event network-changed:246d47a5-6953-4e38-8546-63953a8721cf for instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 on user Apr 12 15:59:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-1b4c5183-a068-4d64-897e-97bb0fe36012 req-221c3529-18b8-4570-a9e0-6811ac4b63ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237319 Apr 12 15:59:32 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61657) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b0606c8b-5334-49dd-b576-f477f7363a44 req-54eec8ec-10ac-48d0-9f2d-a3730a35b6c2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61657) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:36 user devstack@n-api.service[61657]: INFO nova.compute.rpcapi [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 12 15:59:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] Releasing lock "compute-rpcapi-router" {{(pid=61657) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 12 15:59:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9a4ac05a-7afc-4b61-8fc2-41a308b0555c None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094082 Apr 12 15:59:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:36 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-564264734", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e71b9966-9a95-4f66-b3b1-36b05d05853c"}], "security_groups": [{"name": "tempest-securitygroup--397468659"}], "key_name": "tempest-keypair-774364981", "user_data": "}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:36 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] validate_networks() for [('e71b9966-9a95-4f66-b3b1-36b05d05853c', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:38 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}, {"server_uuid": "608fbea2-b42b-4bb9-94a7-2b76dcdc2001", "name": "network-vif-plugged", "status": "completed", "tag": "246d47a5-6953-4e38-8546-63953a8721cf"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:38 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:38 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 15:59:38 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] Creating event network-vif-plugged:246d47a5-6953-4e38-8546-63953a8721cf for instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 on user Apr 12 15:59:38 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-08634167-c0eb-4d74-a2a3-ed732805d682 req-d724ef3f-6854-4e04-a7a0-f395cd0f76ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.085672 Apr 12 15:59:38 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:38 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:38 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-39e6eeb6-57ed-4b35-80b3-7b3a8f425cc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 2.365925 Apr 12 15:59:38 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 25/74] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 15:59:36 2023] POST /compute/v2.1/servers => generated 399 bytes in 2371 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 15:59:38 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f80a63b7-b446-4918-902e-b026fa1d090e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:38 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f80a63b7-b446-4918-902e-b026fa1d090e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:39 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-f80a63b7-b446-4918-902e-b026fa1d090e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:39 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f80a63b7-b446-4918-902e-b026fa1d090e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97" status: 200 len: 1234 microversion: 2.1 time: 0.281564 Apr 12 15:59:39 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 25/75] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 15:59:38 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 => generated 1234 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 15:59:39 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] Creating event network-changed:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 15:59:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-dff64ee4-af5a-4f88-9bf4-b54a9ebac77a req-686715ed-e9b2-4c21-b10a-c11af2f3d742 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143498 Apr 12 15:59:39 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 26/76] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b8d75913-6de2-4746-8e21-e0a06f8594ec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Action: 'create', calling method: .version_select at 0x7fdee7da1a20>, body: {"keypair": {"name": "tempest-keypair-2057580771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJbHdIj6Qnsbz5sPRJ4ye2dl2IsI8e0vfQ09uKxN501bN+DgkHVMylQpwrl7ZvLZ8swmrO3BjtPpMg/5nOMgbnum5uHS/qZKbdglyI6E6LnkEx0Cctk5Q87Mk68+Dgi4A=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:40 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-b8d75913-6de2-4746-8e21-e0a06f8594ec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Getting quotas for project 8197a98d7ebc4230899aca82b073ab15. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:40 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-b8d75913-6de2-4746-8e21-e0a06f8594ec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Getting quotas for user 324eb9033e62405ca2b322bcb6da9a04 and project 8197a98d7ebc4230899aca82b073ab15. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b8d75913-6de2-4746-8e21-e0a06f8594ec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.49 time: 0.244195 Apr 12 15:59:40 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 26/77] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 15:59:40 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 247 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 15:59:40 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608fbea2-b42b-4bb9-94a7-2b76dcdc2001", "name": "network-vif-plugged", "status": "completed", "tag": "246d47a5-6953-4e38-8546-63953a8721cf"}, {"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-plugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}, {"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-plugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Creating event network-vif-plugged:246d47a5-6953-4e38-8546-63953a8721cf for instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 on user Apr 12 15:59:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Creating event network-vif-plugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 15:59:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] Creating event network-vif-plugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 15:59:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-ad90b704-f5a6-47cd-bdf6-98a9001f1e76 req-64a4c0f0-dfdf-47df-9045-2b561bea6c40 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087866 Apr 12 15:59:40 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 26/78] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:41 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=12 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:41 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:41 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] Creating event network-changed:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 15:59:41 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-3e134bfd-d8c2-4fea-8505-05886826eb03 req-1ec0e2d7-2699-4511-8320-b4b98e61cc5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044651 Apr 12 15:59:41 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:45 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 15:59:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-bdd2ba2f-ec94-4d15-b8ec-e37ce3846f6a req-08393d9c-c348-4af1-a9a8-e3d1d49c8218 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047131 Apr 12 15:59:45 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 27/80] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-plugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] Creating event network-vif-plugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 15:59:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-59d4dde2-ca1e-4ce6-a6f6-a3db319ca0f0 req-b9ce2d36-2bd6-4a94-a90c-a9be9cb7f6dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066720 Apr 12 15:59:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 27/81] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 15:59:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-d576cf9b-a914-4672-80c7-b5f09bc68d21 req-8bd35c0f-57e6-40e9-bfd3-fad13aeb4939 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062895 Apr 12 15:59:47 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:47 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-plugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:47 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=12 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:47 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] Creating event network-vif-plugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 15:59:47 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-a751832c-aa2c-4759-8f5a-b0cdd57494ff req-294b6c85-f8cb-426f-a5a3-9f4b785a10a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052307 Apr 12 15:59:47 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 28/83] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "920c6512-180d-46e1-b0cf-240d34c3fc97", "tag": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=20 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=7 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=13 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] Creating event network-changed:f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 on user Apr 12 15:59:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-4681d3bb-a5d4-45f2-86fb-a105dda38f38 req-a13bd578-864e-4db8-aa53-14fb81fc24ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080075 Apr 12 15:59:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 28/84] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1331285489", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "95c64a1b-8b44-403f-8c4c-32730720d7a7"}], "security_groups": [{"name": "tempest-securitygroup--1377150133"}], "key_name": "tempest-keypair-2057580771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:49 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:49 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] validate_networks() for [('95c64a1b-8b44-403f-8c4c-32730720d7a7', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:51 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:51 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=32 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:51 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920c6512-180d-46e1-b0cf-240d34c3fc97", "name": "network-vif-plugged", "status": "completed", "tag": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] Creating event network-vif-plugged:f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 on user Apr 12 15:59:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-2fecab4c-fc9d-4ed3-b682-5c8d55078a80 req-63068e34-ef54-419c-b9e4-2410efc21309 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093584 Apr 12 15:59:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 29/85] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=17 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Getting quotas for project 8197a98d7ebc4230899aca82b073ab15. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Getting quotas for user 324eb9033e62405ca2b322bcb6da9a04 and project 8197a98d7ebc4230899aca82b073ab15. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:52 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b4d6b129-8c2f-474e-9540-10960542114b tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 3.290379 Apr 12 15:59:52 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 29/86] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 15:59:49 2023] POST /compute/v2.1/servers => generated 404 bytes in 3297 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 15:59:52 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-6a041c84-2726-4b5d-b651-1b70bfdfbe34 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:52 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-6a041c84-2726-4b5d-b651-1b70bfdfbe34 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:53 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-6a041c84-2726-4b5d-b651-1b70bfdfbe34 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:53 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-6a041c84-2726-4b5d-b651-1b70bfdfbe34 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:53 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-6a041c84-2726-4b5d-b651-1b70bfdfbe34 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-6a041c84-2726-4b5d-b651-1b70bfdfbe34 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 200 len: 1321 microversion: 2.49 time: 0.389215 Apr 12 15:59:53 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 29/87] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 15:59:52 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 1321 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 15:59:53 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a1db0602-062b-46ac-956d-f1bbbac696bd tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Action: 'create', calling method: .version_select at 0x7fdee7da36d0>, body: {"keypair": {"name": "tempest-keypair-1069057277", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1Wd2ociOIFyjLM0vn+nY1bwPOFKVzmKcdhIhfpYlk3fUbGjg3MnW5Ty147Fnic93nKiDzHzxGNd6ERR69ZW9ZlfleRTXR5NIDgI9vygcdWTL7ncaqq0O00R7QkB5KROw=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:53 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-a1db0602-062b-46ac-956d-f1bbbac696bd tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Getting quotas for project 5a8e21d4dae04fd08951f8306cff0624. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:53 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-a1db0602-062b-46ac-956d-f1bbbac696bd tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Getting quotas for user d2e5f900d0b144f9942de733017fb396 and project 5a8e21d4dae04fd08951f8306cff0624. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:53 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-a1db0602-062b-46ac-956d-f1bbbac696bd tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182326 Apr 12 15:59:53 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 30/88] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 15:59:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920c6512-180d-46e1-b0cf-240d34c3fc97", "name": "network-vif-plugged", "status": "completed", "tag": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] Creating event network-vif-plugged:f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 on user Apr 12 15:59:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-0f0beb50-d61e-40af-b9cb-baa84a7d9732 req-a7fe0b78-7ca7-49fe-89e8-7e639613b67a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066126 Apr 12 15:59:53 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 30/89] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1426192575", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "1316768e-1461-4bd9-b6df-2a43928b62b2"}], "security_groups": [{"name": "tempest-securitygroup--1362517703"}], "key_name": "tempest-keypair-1069057277", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:58 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] validate_networks() for [('1316768e-1461-4bd9-b6df-2a43928b62b2', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 15:59:58 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-69ea934b-ff34-4cb9-888e-a775ce0486c3 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Action: 'create', calling method: .version_select at 0x7fdee7da28c0>, body: {"keypair": {"name": "tempest-keypair-393786", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO19lsCNGEgoB2HHAQYuTR3Xz/r7iAXIlSkC7qzeVq0k3Wmxoc0KYdp4AolUci+hjmn40whJ+Pl38vCo+I61Aw/7to0Te/LrgRb9gUOAeMD8WGVk+4AtHE5vS4Vk7211aA=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:58 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-69ea934b-ff34-4cb9-888e-a775ce0486c3 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Getting quotas for project 672dcb2ce6454ab4aeae3de7550ca8e0. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:58 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-69ea934b-ff34-4cb9-888e-a775ce0486c3 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Getting quotas for user 16ff4a8d98bc4dfa85f0f7d9c0fcebea and project 672dcb2ce6454ab4aeae3de7550ca8e0. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:58 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-69ea934b-ff34-4cb9-888e-a775ce0486c3 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.262431 Apr 12 15:59:58 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 31/90] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 15:59:58 2023] POST /compute/v2.1/os-keypairs => generated 382 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 15:59:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "tag": "4a51084d-9fff-4a53-9387-4542bfd6a4a7"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 15:59:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] Creating event network-changed:4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 15:59:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-5bbabf36-a832-4441-80d7-a51fd75bd177 req-c8184506-58c7-4194-acef-3e5d8be7eb17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076499 Apr 12 15:59:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 31/91] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 15:59:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Getting quotas for project 5a8e21d4dae04fd08951f8306cff0624. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Getting quotas for user d2e5f900d0b144f9942de733017fb396 and project 5a8e21d4dae04fd08951f8306cff0624. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 15:59:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 15:59:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7eefda50-4ec2-4ca9-a470-b369e2aedc10 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.401226 Apr 12 15:59:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 30/92] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 15:59:58 2023] POST /compute/v2.1/servers => generated 404 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 15:59:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e735970e-372a-4581-a24c-52afe793bd95 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 15:59:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e735970e-372a-4581-a24c-52afe793bd95 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 15:59:59 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-e735970e-372a-4581-a24c-52afe793bd95 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e5f900d0b144f9942de733017fb396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8e21d4dae04fd08951f8306cff0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 15:59:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e735970e-372a-4581-a24c-52afe793bd95 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb" status: 200 len: 1226 microversion: 2.1 time: 0.118197 Apr 12 15:59:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 32/93] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 15:59:59 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb => generated 1226 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-179674331", "imageRef": "bfacce9c-c119-4e9b-9797-bddc83436fec", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "f4226065-ecee-4c2b-bbaa-df0406d0d0f6"}], "security_groups": [{"name": "tempest-securitygroup--585615059"}], "key_name": "tempest-keypair-393786", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:02 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] validate_networks() for [('f4226065-ecee-4c2b-bbaa-df0406d0d0f6', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:00:02 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:02 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-plugged", "status": "completed", "tag": "4a51084d-9fff-4a53-9387-4542bfd6a4a7"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] Creating event network-vif-plugged:4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:00:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-0c1ee7f5-5470-4857-a505-3e8e415553f1 req-30a059ab-66a5-4956-b18e-31ff19d37724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046820 Apr 12 16:00:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 31/94] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Getting quotas for project 672dcb2ce6454ab4aeae3de7550ca8e0. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Getting quotas for user 16ff4a8d98bc4dfa85f0f7d9c0fcebea and project 672dcb2ce6454ab4aeae3de7550ca8e0. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:00:03 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bfacce9c-c119-4e9b-9797-bddc83436fec',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:00:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-86a55a41-b7cc-416d-b059-dc8294942a87 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.872363 Apr 12 16:00:03 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 32/95] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:00:01 2023] POST /compute/v2.1/servers => generated 403 bytes in 1878 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:00:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e2e807b7-430a-48f1-bdbb-b0285d717031 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:03 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e2e807b7-430a-48f1-bdbb-b0285d717031 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:03 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=14 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:03 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-e2e807b7-430a-48f1-bdbb-b0285d717031 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ff4a8d98bc4dfa85f0f7d9c0fcebea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672dcb2ce6454ab4aeae3de7550ca8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e2e807b7-430a-48f1-bdbb-b0285d717031 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9" status: 200 len: 1235 microversion: 2.1 time: 0.184334 Apr 12 16:00:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 33/96] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:03 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 => generated 1235 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-plugged", "status": "completed", "tag": "4a51084d-9fff-4a53-9387-4542bfd6a4a7"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] Creating event network-vif-plugged:4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:00:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-14272877-82d0-4d0e-ace9-23c92448f71d req-8d5d2ac5-85b5-4aab-8194-e82e3bab1e63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052451 Apr 12 16:00:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 32/97] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "tag": "0db939d7-60c3-48af-8d8d-0f5528f41bb6"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] Creating event network-changed:0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb on user Apr 12 16:00:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-bb416a69-7ffa-45d9-b837-6bdbd5b81d7f req-af2ed33d-235f-47dc-905d-86522a863e51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045816 Apr 12 16:00:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 33/98] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-d0382817-ea85-40bb-afc8-13f1d27aa2dc tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Action: 'create', calling method: .version_select at 0x7fdee7da25f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-509475392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGrjGxRBnu9rsB4dVnF551Ir+USJO3Xww91Gyq7pzJHhLIC+yf3sqYFIB7zX6y2mMrg16l4hILlV14T+O7phmEsFD6kmLB6HpztKchow4NACtmWzqkjfiJtDlHrmoWu0KQ=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:06 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-d0382817-ea85-40bb-afc8-13f1d27aa2dc tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting quotas for project a46b4e80a65541d6bab94b5edfc26e5b. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:06 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-d0382817-ea85-40bb-afc8-13f1d27aa2dc tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting quotas for user 6acbd977c4b4494db95f879777184489 and project a46b4e80a65541d6bab94b5edfc26e5b. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-d0382817-ea85-40bb-afc8-13f1d27aa2dc tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.376565 Apr 12 16:00:06 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 34/99] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:00:06 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:07 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6614f2c0-399b-43d2-86c9-5790c57575e9", "tag": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] Creating event network-changed:f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 on user Apr 12 16:00:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e64e6da2-e4f6-454d-98be-84131265e580 req-46b4fbce-e373-4928-8c4c-3c454c8993cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398690 Apr 12 16:00:07 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 33/100] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:09 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2046590386", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "33052061-3a43-449e-b742-4ffa29dfc039"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:09 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] validate_networks() for [('33052061-3a43-449e-b742-4ffa29dfc039', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:00:09 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:00:09 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:00:09 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:00:09 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:00:09 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Getting quotas for project 1bde51ff8bde4dcdb14fcda0fc92d564. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Getting quotas for user c5d01dd905404e4aa08a31f25fa53338 and project 1bde51ff8bde4dcdb14fcda0fc92d564. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:00:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "name": "network-vif-plugged", "status": "completed", "tag": "0db939d7-60c3-48af-8d8d-0f5528f41bb6"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d9579462-8181-486a-b3d6-3f39720a280e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.916801 Apr 12 16:00:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 34/101] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:00:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:00:10 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:10 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=8 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fc279c42-06d7-46e8-b7e1-2a40a93d892e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:10 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-fc279c42-06d7-46e8-b7e1-2a40a93d892e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] Creating event network-vif-plugged:0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb on user Apr 12 16:00:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-fbbf2312-bcc5-4831-84fa-cac54893b314 req-e4841de1-9015-4346-83cb-24f886b80677 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112058 Apr 12 16:00:10 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 35/102] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:10 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-fc279c42-06d7-46e8-b7e1-2a40a93d892e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:10 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fc279c42-06d7-46e8-b7e1-2a40a93d892e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f" status: 200 len: 1208 microversion: 2.1 time: 0.231473 Apr 12 16:00:10 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 34/103] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:10 2023] GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f => generated 1208 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6614f2c0-399b-43d2-86c9-5790c57575e9", "name": "network-vif-plugged", "status": "completed", "tag": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] Creating event network-vif-plugged:f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 on user Apr 12 16:00:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-1e846313-7cf2-4b9d-8ec0-86effabd1d16 req-29f13a02-7481-4467-acb1-7d96eba3da4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030104 Apr 12 16:00:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 35/104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "name": "network-vif-plugged", "status": "completed", "tag": "0db939d7-60c3-48af-8d8d-0f5528f41bb6"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] Creating event network-vif-plugged:0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb on user Apr 12 16:00:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e5c6f874-8beb-411e-bc9a-1d7c15be62dd req-d5448c5d-8517-48bc-b3d9-beff8dadafce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 Apr 12 16:00:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 35/105] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:12 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5058877b-1645-42e7-a78d-7113c31cfe1f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872" status: 200 len: 1503 microversion: 2.1 time: 0.392234 Apr 12 16:00:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 36/106] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:12 2023] GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6614f2c0-399b-43d2-86c9-5790c57575e9", "name": "network-vif-plugged", "status": "completed", "tag": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] Creating event network-vif-plugged:f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 on user Apr 12 16:00:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-280a30b8-4d6b-40f6-976d-f5597da0a5ab req-cc1856c6-f8ff-4c83-8748-6b1536cf01ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033715 Apr 12 16:00:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 36/107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:12 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2d1f495d-fae1-4104-905b-fdddecfed490 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001" status: 200 len: 1691 microversion: 2.87 time: 0.295154 Apr 12 16:00:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 36/108] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:00:12 2023] GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:00:13 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abbb6742-17d0-46b3-87ba-c14abc06738f", "tag": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] Creating event network-changed:fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance abbb6742-17d0-46b3-87ba-c14abc06738f on user Apr 12 16:00:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-23cb3b38-95c0-417a-a978-09e992c2c391 req-9c972340-cc90-4e92-b417-c843c9b46cac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035460 Apr 12 16:00:13 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:15 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbb6742-17d0-46b3-87ba-c14abc06738f", "name": "network-vif-plugged", "status": "completed", "tag": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:15 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:15 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:15 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:15 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] Creating event network-vif-plugged:fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance abbb6742-17d0-46b3-87ba-c14abc06738f on user Apr 12 16:00:15 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e1f1201c-5f77-4e66-83b7-1879ba118749 req-ab63872c-93fa-41f3-9320-87237885c440 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037114 Apr 12 16:00:15 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 37/110] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1745076225", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-509475392", "security_groups": [{"name": "tempest-secgroup-smoke-773574276"}], "networks": [{"uuid": "0b7c67f6-057a-4bb5-aa44-db5290d55865"}], "block_device_mapping_v2": [{"uuid": "863633c1-6f4e-41f5-b72c-91ca428b73b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] validate_networks() for [('0b7c67f6-057a-4bb5-aa44-db5290d55865', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting quotas for project a46b4e80a65541d6bab94b5edfc26e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Getting quotas for user 6acbd977c4b4494db95f879777184489 and project a46b4e80a65541d6bab94b5edfc26e5b. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:00:17 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='863633c1-6f4e-41f5-b72c-91ca428b73b2',volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:00:17 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=16 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abbb6742-17d0-46b3-87ba-c14abc06738f", "name": "network-vif-plugged", "status": "completed", "tag": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:17 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] Creating event network-vif-plugged:fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance abbb6742-17d0-46b3-87ba-c14abc06738f on user Apr 12 16:00:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d0893008-c0b1-43d7-a0bb-82cfe2ba1cf8 req-7135f797-861f-49e1-9758-a33a19137cc1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188703 Apr 12 16:00:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 38/111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d8eb1b94-364c-4285-9f8a-15ad4eb217af tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.158540 Apr 12 16:00:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 37/112] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:00:16 2023] POST /compute/v2.1/servers => generated 403 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:00:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-96abc36a-b7bd-40f5-bc98-d45eb1d933fb tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:18 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-96abc36a-b7bd-40f5-bc98-d45eb1d933fb tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:18 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-96abc36a-b7bd-40f5-bc98-d45eb1d933fb tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-96abc36a-b7bd-40f5-bc98-d45eb1d933fb tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1083 microversion: 2.1 time: 0.159093 Apr 12 16:00:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 38/113] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:18 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1083 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:20 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7c539bd9-7c4e-44cf-b46c-1f967b125691 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1538 microversion: 2.1 time: 0.512415 Apr 12 16:00:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 39/114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:19 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1538 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=12 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:20 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5f5fa410-1e9e-484d-a6fa-92f45bafea83 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 200 len: 1586 microversion: 2.20 time: 0.594902 Apr 12 16:00:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 38/115] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:00:20 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 1586 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:00:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:22 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] Creating event network-changed:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:00:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-d5dbb82e-2fb3-43fc-80fb-179e854aa854 req-e11e9d6b-4166-4ca1-b927-1c45e86c353e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035014 Apr 12 16:00:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 39/116] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b8e2682d-6b6c-4e13-83c3-37b059b029be tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Action: 'create', calling method: .version_select at 0x7fdee7da3910>, body: {"keypair": {"name": "tempest-keypair-1782217974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLrB1DENR2pfOAjIRN9LEpsOVcpe9+tGHSdMunlhJFwYQlpEscFgY1JRfeVyTGaP039pStXo0RFjA+WSluJoqeyqAo5WqwaznRFWsI938ay0ZUrGDMwsQVNkx94RdMc5mA=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:24 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-b8e2682d-6b6c-4e13-83c3-37b059b029be tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting quotas for project 14aea401da6344858416fd2543bc10ca. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:24 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-b8e2682d-6b6c-4e13-83c3-37b059b029be tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting quotas for user 896a788283bf4e88b30528ef2721e90c and project 14aea401da6344858416fd2543bc10ca. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b8e2682d-6b6c-4e13-83c3-37b059b029be tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.059375 Apr 12 16:00:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 40/117] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 16:00:24 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 61 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 16:00:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-42887822", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "77f1158d-0720-49c1-9530-29d3cdca64df"}, {"port": "8ebc1d23-a473-4640-aa39-31cbed300c07", "tag": "port-1"}, {"port": "7f36bae3-c729-4d85-8c31-075b2b100abe", "tag": "port-2"}, {"uuid": "9b0c9550-d764-4db6-b28b-09ab59801170", "tag": "net-1"}, {"uuid": "9b0c9550-d764-4db6-b28b-09ab59801170"}, {"uuid": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "b2fde1cb-bd86-48a5-8aca-463fdf3444b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a0100e6d-5149-423c-aadc-0c4f2635196b", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1954172272"}], "key_name": "tempest-keypair-1782217974", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:27 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] validate_networks() for [('77f1158d-0720-49c1-9530-29d3cdca64df', None, None, None, None, None), (None, None, '8ebc1d23-a473-4640-aa39-31cbed300c07', None, None, None), (None, None, '7f36bae3-c729-4d85-8c31-075b2b100abe', None, None, None), ('9b0c9550-d764-4db6-b28b-09ab59801170', None, None, None, None, None), ('9b0c9550-d764-4db6-b28b-09ab59801170', None, None, None, None, None), ('92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1', '10.2.2.100', None, None, None, None), ('92fe4d7e-c0cd-45f1-9e92-a120ab22f6f1', '10.2.2.200', None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:00:27 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:27 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=18 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:28 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:28 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-02810df3-1215-4d1c-b640-8328b1745dd1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Action: 'create', calling method: .version_select at 0x7fdee863a830>, body: {"keypair": {"name": "tempest-keypair-302611627", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLQXDyGxnW8Y8uGnRNVHYUbX23R7I4pLI6ZbfyCvQF/VJCuiE4FcFV1q49XDBUk5vZYnAPb/+RlfqgPWZ19CwkWt6aeUKiPxRYOkBEiwZu+X1jwZm0eXBg0fxd57kvoRA=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:28 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-02810df3-1215-4d1c-b640-8328b1745dd1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting quotas for project 020f60d454f846d5a18dfbe1d88b65da. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:28 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-02810df3-1215-4d1c-b640-8328b1745dd1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting quotas for user 51e8a84c876249dd9b588305926ffdff and project 020f60d454f846d5a18dfbe1d88b65da. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-02810df3-1215-4d1c-b640-8328b1745dd1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.052170 Apr 12 16:00:28 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 40/118] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 16:00:28 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:29 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-14ec62ed-3731-4dca-bd17-83cdcc3761db tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97" status: 200 len: 1543 microversion: 2.1 time: 0.191418 Apr 12 16:00:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 41/119] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:29 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 => generated 1543 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=28 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting quotas for project 14aea401da6344858416fd2543bc10ca. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Getting quotas for user 896a788283bf4e88b30528ef2721e90c and project 14aea401da6344858416fd2543bc10ca. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:00:29 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='b2fde1cb-bd86-48a5-8aca-463fdf3444b0',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='33dbc39f-129d-4c7d-9b6d-d9fd14f5d6c4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a0100e6d-5149-423c-aadc-0c4f2635196b',volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:00:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-53148cbb-5d6a-4be7-827a-243acbdff5d4 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.076620 Apr 12 16:00:30 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 39/120] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 16:00:26 2023] POST /compute/v2.1/servers => generated 404 bytes in 3079 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 16:00:30 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-28f2c3c7-f4c0-455f-b5fc-2137a0556c54 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:30 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-28f2c3c7-f4c0-455f-b5fc-2137a0556c54 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:30 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-28f2c3c7-f4c0-455f-b5fc-2137a0556c54 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:30 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-28f2c3c7-f4c0-455f-b5fc-2137a0556c54 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:30 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-28f2c3c7-f4c0-455f-b5fc-2137a0556c54 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:30 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-28f2c3c7-f4c0-455f-b5fc-2137a0556c54 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 200 len: 1278 microversion: 2.42 time: 0.067269 Apr 12 16:00:30 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 41/121] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:00:30 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 1278 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:00:30 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1486400569", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "db8367a7-06c5-4e83-987a-c92d02009fef"}, {"port": "6c9be856-3e7e-4166-8d71-a1f5330aa82f", "tag": "port-1"}, {"port": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475", "tag": "port-2"}, {"uuid": "a491fcd5-d137-491a-9854-a743afbd448d", "tag": "net-1"}, {"uuid": "a491fcd5-d137-491a-9854-a743afbd448d"}, {"uuid": "c543f5eb-b28c-4113-a560-8d6790713d19", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "c543f5eb-b28c-4113-a560-8d6790713d19", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5a3e6bdc-d274-4e4a-ac05-59caa88e13d4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "1c11ebd7-2275-4a31-9558-6af01638a09b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9b990634-7cec-49db-9df4-81d3a3f3b0fd", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--926589151"}], "key_name": "tempest-keypair-302611627", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:30 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] validate_networks() for [('db8367a7-06c5-4e83-987a-c92d02009fef', None, None, None, None, None), (None, None, '6c9be856-3e7e-4166-8d71-a1f5330aa82f', None, None, None), (None, None, 'cd2391ad-cb7a-47be-b062-b0dbbc1f8475', None, None, None), ('a491fcd5-d137-491a-9854-a743afbd448d', None, None, None, None, None), ('a491fcd5-d137-491a-9854-a743afbd448d', None, None, None, None, None), ('c543f5eb-b28c-4113-a560-8d6790713d19', '10.2.2.100', None, None, None, None), ('c543f5eb-b28c-4113-a560-8d6790713d19', '10.2.2.200', None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:00:32 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] Creating event network-vif-plugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:00:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-cac16505-dac9-45c7-a2be-8d1349733f65 req-f04c6ba5-4308-43e2-a38d-5946a3dbdcd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033839 Apr 12 16:00:32 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 40/122] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:34 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=16 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] Creating event network-vif-plugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:00:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3a1db241-96e4-46fd-8573-afcab837d432 req-ac112e76-a5b6-4e7a-a004-e7068bba435c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030801 Apr 12 16:00:34 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 42/123] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=25 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting quotas for project 020f60d454f846d5a18dfbe1d88b65da. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:00:34 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Getting quotas for user 51e8a84c876249dd9b588305926ffdff and project 020f60d454f846d5a18dfbe1d88b65da. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:00:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:00:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5a3e6bdc-d274-4e4a-ac05-59caa88e13d4',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='1c11ebd7-2275-4a31-9558-6af01638a09b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b990634-7cec-49db-9df4-81d3a3f3b0fd',volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:00:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-14ab97fd-ed0c-43ca-b6af-6e0300681acb tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.32 time: 4.816401 Apr 12 16:00:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 42/124] 10.0.0.210 () {66 vars in 1266 bytes} [Wed Apr 12 16:00:30 2023] POST /compute/v2.1/servers => generated 403 bytes in 4819 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 16:00:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-cbd8b9c4-b709-4eb3-af80-f17ec8bcfee7 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-cbd8b9c4-b709-4eb3-af80-f17ec8bcfee7 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:35 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-cbd8b9c4-b709-4eb3-af80-f17ec8bcfee7 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:35 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-cbd8b9c4-b709-4eb3-af80-f17ec8bcfee7 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:35 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-cbd8b9c4-b709-4eb3-af80-f17ec8bcfee7 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:35 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-cbd8b9c4-b709-4eb3-af80-f17ec8bcfee7 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 200 len: 1279 microversion: 2.32 time: 0.090052 Apr 12 16:00:35 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 41/125] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:00:35 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:00:37 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "0d6194a7-a3c4-47f9-8c37-960cb622ce28"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] Creating event network-changed:0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-65f09eaf-d15f-451a-82fd-9624cd7e60de req-66819754-7c36-4dfe-a6db-c27bd6d4ae5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041800 Apr 12 16:00:37 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 43/126] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "8ebc1d23-a473-4640-aa39-31cbed300c07"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] Creating event network-changed:8ebc1d23-a473-4640-aa39-31cbed300c07 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-835f12b1-d5d9-4545-a1a9-b9a54e3b6b09 req-237235e4-1fd2-4a1a-aab3-f4aeb3a675fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041126 Apr 12 16:00:40 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 43/127] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:40 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:40 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "7ae43e60-f63a-448e-9a89-0d6bff272104"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:40 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] Creating event network-changed:7ae43e60-f63a-448e-9a89-0d6bff272104 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:00:40 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-870e2918-0df0-42aa-a552-d16352a7b38f req-947c5838-43a0-4347-9bff-50a188a65804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052587 Apr 12 16:00:40 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "7f36bae3-c729-4d85-8c31-075b2b100abe"}, {"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:42 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Creating event network-changed:7f36bae3-c729-4d85-8c31-075b2b100abe for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] Creating event network-changed:264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-944c370c-dffc-497a-8488-bb22747dfdc4 req-de097f8b-5771-4fc5-bd97-f0852a2cccf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041135 Apr 12 16:00:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:42 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "6c9be856-3e7e-4166-8d71-a1f5330aa82f"}, {"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Creating event network-changed:6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:00:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] Creating event network-changed:cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:00:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-e5fb56a1-037c-4c47-92e8-4e1d1fd6412e req-0c6cf205-3282-4565-ac54-8f12a13c5479 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.040513 Apr 12 16:00:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 44/130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:42 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:43 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b486c662-03a3-4003-bad9-9b17bda73eec tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 200 len: 1626 microversion: 2.49 time: 0.329600 Apr 12 16:00:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 43/131] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:00:43 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 1626 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:00:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "e3f484fe-17dd-4cef-babd-ad78cf557b03"}, {"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "f76aae02-12c4-41d6-951a-201330ea7693"}, {"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "b85b7f43-1f5d-441a-bf3e-380900194e10"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Creating event network-changed:e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Creating event network-changed:f76aae02-12c4-41d6-951a-201330ea7693 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:00:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] Creating event network-changed:b85b7f43-1f5d-441a-bf3e-380900194e10 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:00:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-9a2b1083-3ba0-489a-bf25-200b0cd7d4ed req-79dfa6ba-1077-4394-a9e7-86a6cfaa387d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.038059 Apr 12 16:00:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 45/132] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:44 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:45 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "0b2175eb-de94-4274-b200-14894dbcbda0"}, {"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "5796cf52-4e81-4c40-954e-86819f5557c8"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:45 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:45 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=10 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Creating event network-changed:0b2175eb-de94-4274-b200-14894dbcbda0 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] Creating event network-changed:5796cf52-4e81-4c40-954e-86819f5557c8 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-9a8f8659-d4be-4d2e-b91a-16fce1d9bc5c req-8005dedb-0044-4a57-9b16-c09fcab47b0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.042955 Apr 12 16:00:45 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 45/133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:45 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:46 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b"}, {"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "1d70ad7b-92c6-47fa-a411-cef9d6159e90"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:46 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=8 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Creating event network-changed:c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:00:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] Creating event network-changed:1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:00:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-3bcfce5f-a066-495c-b4a5-22f3c0094601 req-dda2539e-09f7-40dc-9c08-e77b591c873d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033089 Apr 12 16:00:46 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 44/134] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:46 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:50 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e5f900d0b144f9942de733017fb396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8e21d4dae04fd08951f8306cff0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-887afcb0-4efa-420c-9666-6c2a235eb01e tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb" status: 200 len: 1527 microversion: 2.1 time: 0.255996 Apr 12 16:00:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 46/135] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:50 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb => generated 1527 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:54 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ff4a8d98bc4dfa85f0f7d9c0fcebea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672dcb2ce6454ab4aeae3de7550ca8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:00:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-459845d2-4206-47f4-adca-919a37273337 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9" status: 200 len: 1544 microversion: 2.1 time: 0.150626 Apr 12 16:00:54 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 46/136] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:00:54 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 => generated 1544 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:54 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "0d6194a7-a3c4-47f9-8c37-960cb622ce28"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:54 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] Creating event network-vif-plugged:0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-ca91ef7a-7135-467c-b05a-6999c806b3c0 req-9668ee81-0e41-4a4f-b6ea-cd014e3bc33c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052640 Apr 12 16:00:54 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 45/137] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:00:56 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "e3f484fe-17dd-4cef-babd-ad78cf557b03"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] Creating event network-vif-plugged:e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-94b1b4b0-0ebd-4067-a7bb-4fc9d0f0e1ef req-f45472fd-4c8f-4b21-8068-0b595a260d1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034679 Apr 12 16:00:56 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:56 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "0d6194a7-a3c4-47f9-8c37-960cb622ce28"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "8ebc1d23-a473-4640-aa39-31cbed300c07"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "8ebc1d23-a473-4640-aa39-31cbed300c07"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "7f36bae3-c729-4d85-8c31-075b2b100abe"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "7f36bae3-c729-4d85-8c31-075b2b100abe"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Creating event network-vif-plugged:0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Creating event network-vif-plugged:8ebc1d23-a473-4640-aa39-31cbed300c07 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Creating event network-vif-plugged:8ebc1d23-a473-4640-aa39-31cbed300c07 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Creating event network-vif-plugged:7f36bae3-c729-4d85-8c31-075b2b100abe for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Creating event network-vif-plugged:7f36bae3-c729-4d85-8c31-075b2b100abe for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] Creating event network-vif-plugged:264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:57 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-4687ce71-4e2e-416f-82d2-283eaed57380 req-4df7d7ac-fc00-4158-a1b3-042b523a7a12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.036609 Apr 12 16:00:57 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 47/139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:56 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:00:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "e3f484fe-17dd-4cef-babd-ad78cf557b03"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "0b2175eb-de94-4274-b200-14894dbcbda0"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "0b2175eb-de94-4274-b200-14894dbcbda0"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Creating event network-vif-plugged:e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Creating event network-vif-plugged:0b2175eb-de94-4274-b200-14894dbcbda0 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] Creating event network-vif-plugged:0b2175eb-de94-4274-b200-14894dbcbda0 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-a1b62eb0-f09f-4d53-91f2-36f75e2737d9 req-ee30e2be-dbeb-4fe9-8833-b34dfeeca753 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033258 Apr 12 16:00:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:58 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:00:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "5796cf52-4e81-4c40-954e-86819f5557c8"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "5796cf52-4e81-4c40-954e-86819f5557c8"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:00:59 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:00:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:00:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:00:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:00:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Creating event network-vif-plugged:264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Creating event network-vif-plugged:5796cf52-4e81-4c40-954e-86819f5557c8 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] Creating event network-vif-plugged:5796cf52-4e81-4c40-954e-86819f5557c8 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:00:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-f0b2546d-8b15-45d9-b147-c35ac2ffb3f3 req-e89ddc38-777b-4fa6-af10-7a1b8eae5778 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034044 Apr 12 16:00:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 48/141] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:00:59 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "6c9be856-3e7e-4166-8d71-a1f5330aa82f"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:00 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-ccae70f0-796c-4855-9daa-2191e1d1d26a tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f" status: 200 len: 1485 microversion: 2.1 time: 0.217895 Apr 12 16:01:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 48/142] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:01:00 2023] GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f => generated 1485 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:01:00 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=18 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] Creating event network-vif-plugged:6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-a593aac0-d85a-4c6c-afbe-0626a3517627 req-874bf06c-1394-4c7f-a8cd-72ba13386ac8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067733 Apr 12 16:01:00 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 47/143] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:01 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "7ae43e60-f63a-448e-9a89-0d6bff272104"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "7ae43e60-f63a-448e-9a89-0d6bff272104"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Creating event network-vif-plugged:7ae43e60-f63a-448e-9a89-0d6bff272104 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Creating event network-vif-plugged:7ae43e60-f63a-448e-9a89-0d6bff272104 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] Creating event network-vif-plugged:cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-8d11c225-719a-4781-894e-1904be55a314 req-e901e996-51e2-4a5e-bbc3-c9407dce6a0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.044343 Apr 12 16:01:01 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 49/144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:01 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:01 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "b85b7f43-1f5d-441a-bf3e-380900194e10"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] Creating event network-vif-plugged:b85b7f43-1f5d-441a-bf3e-380900194e10 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-4f997ecf-2eec-41f7-b5af-89b3e734a636 req-b0dcf71d-426b-40ca-9a34-a696d8ecc74b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040903 Apr 12 16:01:01 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 49/145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:02 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "6c9be856-3e7e-4166-8d71-a1f5330aa82f"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "f76aae02-12c4-41d6-951a-201330ea7693"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "f76aae02-12c4-41d6-951a-201330ea7693"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Creating event network-vif-plugged:6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Creating event network-vif-plugged:f76aae02-12c4-41d6-951a-201330ea7693 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] Creating event network-vif-plugged:f76aae02-12c4-41d6-951a-201330ea7693 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-9d88c674-30af-49fc-bac2-ef8707918b35 req-ccc4ffcb-099f-4ce7-a307-7f36bb2fe9b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.052782 Apr 12 16:01:02 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:02 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] Creating event network-vif-plugged:cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-080fc052-3cc1-42a4-ba2d-35122cf083d5 req-47ee37b0-942d-4a37-b847-c1355a424734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031215 Apr 12 16:01:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "b85b7f43-1f5d-441a-bf3e-380900194e10"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "1d70ad7b-92c6-47fa-a411-cef9d6159e90"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "1d70ad7b-92c6-47fa-a411-cef9d6159e90"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Creating event network-vif-plugged:b85b7f43-1f5d-441a-bf3e-380900194e10 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Creating event network-vif-plugged:c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Creating event network-vif-plugged:c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Creating event network-vif-plugged:1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] Creating event network-vif-plugged:1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:01:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-106fc134-8860-4762-b3c8-673bc812ffd0 req-8710cbd3-efc0-4d02-923b-2e1072820d9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.032149 Apr 12 16:01:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 50/148] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:03 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:08 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2cbc1a49-9287-4d0f-8867-3bb1312493ff tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1431 microversion: 2.1 time: 0.149822 Apr 12 16:01:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 49/149] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:01:08 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1431 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=23 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:12 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid 473a30c4-5aa4-481c-8859-fda815d14872 {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:01:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-4726d4e0-7ba7-443b-8b86-33cc57264b7d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872/action" status: 200 len: 32 microversion: 2.1 time: 0.198550 Apr 12 16:01:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 51/150] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:01:12 2023] POST /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=26 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:12 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-cb3805f7-3e92-4ef6-b5c3-947873ac1a60 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872" status: 200 len: 1509 microversion: 2.1 time: 0.240852 Apr 12 16:01:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 51/151] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:01:12 2023] GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1308123405"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-unplugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] Creating event network-vif-unplugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 16:01:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-7cb9b50b-351d-4b11-b508-602e8cbcd3a4 req-8bc44427-f535-454a-b5bd-6e765d809f20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033735 Apr 12 16:01:13 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 52/152] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6f6c6da5-ca3f-49d4-9bbc-9385672c0913 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/action" status: 202 len: 52 microversion: 2.87 time: 1.050737 Apr 12 16:01:14 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 50/153] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:01:12 2023] POST /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001/action => generated 52 bytes in 1052 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 16:01:15 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-plugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:15 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] Creating event network-vif-plugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 16:01:15 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-9ffccfa2-17f2-4f19-9dff-6433b6c8d120 req-e1dfe9b9-9b59-4d04-8ab4-91016fb39bda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032656 Apr 12 16:01:15 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 52/154] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:17 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-plugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}, {"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-plugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Creating event network-vif-plugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 16:01:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] Creating event network-vif-plugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 16:01:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-4c0bedbf-4971-458e-b19e-a70fe20eb270 req-87460ba8-4be6-463d-aa0c-a47e41c5fa0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046015 Apr 12 16:01:17 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 53/155] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:17 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5d390e02-c4b4-4277-8b58-20a83dfb9211 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.123292 Apr 12 16:01:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 51/156] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:01:20 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-interface => generated 282 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:20 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-dcf59bc8-d626-48e6-9632-7048a3b1c66e tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 200 len: 2828 microversion: 2.42 time: 0.309428 Apr 12 16:01:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 53/157] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:01:20 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 2828 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:20 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-adc8f585-e5f3-4af7-838e-72e9ba8b9497 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001" status: 200 len: 1691 microversion: 2.87 time: 0.377206 Apr 12 16:01:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 54/158] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:01:20 2023] GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => generated 1691 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-534efddb-4d27-4def-9eaf-2767c0c78d90 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.263002 Apr 12 16:01:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 52/159] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 16:01:20 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-interface => generated 282 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:01:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] Creating event network-changed:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:01:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-dd713f13-0a36-4b2d-8d01-e813a2aa1a6b req-7ada7767-b9fd-4aeb-9d89-88d3308eb2e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048328 Apr 12 16:01:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 54/160] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-cf068171-eed2-4b6b-afd2-b105938fe07d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1538 microversion: 2.1 time: 0.273561 Apr 12 16:01:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 55/161] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:01:21 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1538 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-35ebda6d-ef63-48e2-b9ab-0e1388660e45 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1538 microversion: 2.1 time: 0.188227 Apr 12 16:01:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 53/162] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:01:22 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1538 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:01:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] Creating event network-changed:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:01:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-a26d3bc3-f0b8-49eb-8e99-fd3c722e4797 req-9c9400d7-82f6-4cc5-99be-8712da5f56b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038459 Apr 12 16:01:22 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 55/163] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-28c52de5-e157-4812-9c6b-b259b1842c2a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/ips" status: 200 len: 109 microversion: 2.20 time: 0.047163 Apr 12 16:01:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 56/164] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 16:01:22 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/ips => generated 109 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=18 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:25 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'flavor' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=20 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:26 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:26 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:26 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-95840cb3-64b5-4f55-a4a4-5f7e3f1a4be0 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 200 len: 2819 microversion: 2.32 time: 0.478077 Apr 12 16:01:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 56/165] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:01:25 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 2819 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:01:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-fb212069-492d-4005-ab77-4bc33d17c70c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/action" status: 202 len: 0 microversion: 2.20 time: 1.145260 Apr 12 16:01:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 54/166] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:01:25 2023] POST /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/action => generated 0 bytes in 1147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:26 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3710f525-01ce-42f4-9976-e6648338c483 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 200 len: 1710 microversion: 2.20 time: 0.236930 Apr 12 16:01:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 57/167] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:01:26 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 1710 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:01:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-unplugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] Creating event network-vif-unplugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:01:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-66cb3b4b-3b5a-40a5-afe1-2ac37efa16fe req-ce012a15-c0ce-454a-9b9d-3c54c5ecd2a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.128187 Apr 12 16:01:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 57/168] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-plugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] Creating event network-vif-plugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:01:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-805fca58-bafa-4932-b657-50461bb4b027 req-ab80ee74-e33e-47f9-97f0-9f540cb42ddc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028472 Apr 12 16:01:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 55/169] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=22 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-142201b1-4084-4df3-8b77-b729af5bdd15 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.085481 Apr 12 16:01:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 58/170] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:01:29 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-interface => generated 283 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:31 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "920c6512-180d-46e1-b0cf-240d34c3fc97", "tag": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:31 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:31 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:31 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:31 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:31 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] Creating event network-changed:f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 on user Apr 12 16:01:31 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-74d581f5-0dd5-4576-bc1d-9e0dfdf367e5 req-c3738d45-5669-4812-ab19-6e760c35bdf2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034007 Apr 12 16:01:31 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 56/171] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:31 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-8922a28c-95cc-416e-adf5-9f94f2477213 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/ips" status: 200 len: 108 microversion: 2.1 time: 0.084423 Apr 12 16:01:31 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 58/172] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:01:31 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/ips => generated 108 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d4e6a19-342a-43eb-b9dc-9570b802fbe6"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:33 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3afac93c-dc2a-45c5-93e7-4e8ffc453b7c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.368154 Apr 12 16:01:33 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 59/173] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:01:32 2023] POST /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-6d3bc9d8-8bcb-41f0-9eb1-d6d5376497e5 req-9c676833-dcc1-484d-83f1-794517840889 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d3bc9d8-8bcb-41f0-9eb1-d6d5376497e5 req-9c676833-dcc1-484d-83f1-794517840889 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d3bc9d8-8bcb-41f0-9eb1-d6d5376497e5 req-9c676833-dcc1-484d-83f1-794517840889 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d3bc9d8-8bcb-41f0-9eb1-d6d5376497e5 req-9c676833-dcc1-484d-83f1-794517840889 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.compute.server_external_events [req-6d3bc9d8-8bcb-41f0-9eb1-d6d5376497e5 req-9c676833-dcc1-484d-83f1-794517840889 service nova] Unable to find a host for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045. Dropping event network-changed {{(pid=61659) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 12 16:01:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-6d3bc9d8-8bcb-41f0-9eb1-d6d5376497e5 req-9c676833-dcc1-484d-83f1-794517840889 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 176 microversion: 2.1 time: 0.025727 Apr 12 16:01:33 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 57/174] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:33 2023] POST /compute/v2.1/os-server-external-events => generated 176 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 12 16:01:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-27d870eb-134e-4660-b226-bad4d1e4240c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: .version_select at 0x7fdee7da15a0>, body: {"keypair": {"name": "tempest-keypair-42069222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJELhHYsdQbAcbonk0277g3DJfP1LvsNujwWmlOlhfoJ8a2xLQrIa61OTMaRnrdudqA+4xM9N9X+ZeIYSCcD9wAL76iQKzBebuY1vOBSqr/XwJdRR6IbRCAYmOPGIb2tg=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:39 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-27d870eb-134e-4660-b226-bad4d1e4240c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:01:39 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-27d870eb-134e-4660-b226-bad4d1e4240c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:01:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-27d870eb-134e-4660-b226-bad4d1e4240c tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.050618 Apr 12 16:01:39 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 59/175] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:01:39 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2145243343", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e71b9966-9a95-4f66-b3b1-36b05d05853c"}], "security_groups": [{"name": "tempest-securitygroup--1203377573"}], "key_name": "tempest-keypair-42069222", "user_data": "}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] validate_networks() for [('e71b9966-9a95-4f66-b3b1-36b05d05853c', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:42 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:01:42 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:01:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:01:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:01:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fb747c59-6845-4c51-8159-c728c40b97de tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.940223 Apr 12 16:01:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 60/176] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:01:41 2023] POST /compute/v2.1/servers => generated 400 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:01:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-bbaea26a-e41f-47c9-8325-149a42d386b7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-bbaea26a-e41f-47c9-8325-149a42d386b7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:42 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-bbaea26a-e41f-47c9-8325-149a42d386b7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-bbaea26a-e41f-47c9-8325-149a42d386b7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190" status: 200 len: 1234 microversion: 2.1 time: 0.071529 Apr 12 16:01:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 58/177] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:01:42 2023] GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 => generated 1234 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=29 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-01372c9d-a5ce-4ef8-a5f0-22f840e2de7c tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.133968 Apr 12 16:01:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 60/178] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 16:01:43 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-interface => generated 282 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:01:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad0cece6-9b26-4c87-9e48-2c0437cb9190", "tag": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:44 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] Creating event network-changed:b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 on user Apr 12 16:01:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-24355eed-a689-4792-ad12-02a065c48942 req-65ca2c03-07c2-4919-abea-b131c4f95e16 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035404 Apr 12 16:01:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 61/179] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:44 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "tag": "4a51084d-9fff-4a53-9387-4542bfd6a4a7"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:44 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] Creating event network-changed:4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:01:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-087b29f6-b999-408c-a678-7eee2f12f46a req-ada1ec32-f1fe-4796-b892-a460ac3c7637 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030584 Apr 12 16:01:44 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 59/180] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:45 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:45 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:45 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:01:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c0ff31ff-261d-4728-92a7-d6244b07e05d tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 200 len: 1626 microversion: 2.49 time: 0.184800 Apr 12 16:01:45 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:01:44 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 1626 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "4080a87a-33fc-4ac1-a7a0-a514db7dcb08", "tag": "nic-tag"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:46 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0cece6-9b26-4c87-9e48-2c0437cb9190", "name": "network-vif-plugged", "status": "completed", "tag": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] Creating event network-vif-plugged:b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 on user Apr 12 16:01:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-7e76f9c8-bbed-4ca4-88f4-914538af063c req-dae7b764-8ccb-41ba-bc55-17dd065a0459 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Apr 12 16:01:46 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:48 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:48 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:48 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:48 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:48 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:48 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:48 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:48 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ba8ef66f-a6d2-44b5-b9f2-7e2a78aff5a2 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.431399 Apr 12 16:01:48 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 62/183] 10.0.0.210 () {66 vars in 1414 bytes} [Wed Apr 12 16:01:45 2023] POST /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-interface => generated 283 bytes in 3433 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2f0d62b-ba81-4361-8238-57417c052465", "tag": "volume-tag"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:48 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-bbed4048-4927-42b3-adfd-56163d11e8c8 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "POST /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.363328 Apr 12 16:01:48 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 62/184] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 16:01:48 2023] POST /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:01:48 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0cece6-9b26-4c87-9e48-2c0437cb9190", "name": "network-vif-plugged", "status": "completed", "tag": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0"}, {"name": "network-changed", "server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "tag": "9e66bcb0-73bf-4d5e-b20a-b26443302fca"}, {"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-plugged", "status": "completed", "tag": "9e66bcb0-73bf-4d5e-b20a-b26443302fca"}, {"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-plugged", "status": "completed", "tag": "9e66bcb0-73bf-4d5e-b20a-b26443302fca"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Creating event network-vif-plugged:b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 on user Apr 12 16:01:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Creating event network-changed:9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:01:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Creating event network-vif-plugged:9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:01:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] Creating event network-vif-plugged:9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:01:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-5d420f2a-32cd-4a7f-94bc-766a4d631b67 req-e51cffb5-ec83-4b74-b080-5e6985762932 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 692 microversion: 2.1 time: 0.050634 Apr 12 16:01:48 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:48 2023] POST /compute/v2.1/os-server-external-events => generated 692 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-65d359c9-ab30-400f-8d0e-2f768b5eeea5 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.092051 Apr 12 16:01:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 63/186] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:01:50 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-interface => generated 283 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:51 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:51 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "tag": "0db939d7-60c3-48af-8d8d-0f5528f41bb6"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] Creating event network-changed:0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb on user Apr 12 16:01:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-f651cd77-e25e-49c9-a6c7-337c7150c8f9 req-1c0a9e6e-59b2-4667-b750-fbc5bbca1359 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041006 Apr 12 16:01:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 63/187] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5403a600-a3bb-44d7-b9b8-bf933454ca76"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-58f5cfc4-290d-41ea-9884-3f24c9816f7b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.354936 Apr 12 16:01:51 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 62/188] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:01:51 2023] POST /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:54 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d8552526-f242-44fa-a4dd-e9331a351bf0 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.159499 Apr 12 16:01:54 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 64/189] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:01:54 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-interface => generated 282 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6614f2c0-399b-43d2-86c9-5790c57575e9", "tag": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] Creating event network-changed:f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 on user Apr 12 16:01:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-c1f1fdba-614d-4b25-8ed0-23db99b89a67 req-8b4fbc89-f069-4b3e-bfe3-893eb6fbefbd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038757 Apr 12 16:01:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 64/190] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=20 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:56 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lazy-loading 'services' on Instance uuid 55aff314-eb5e-4752-af9f-a4021e970cac {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:01:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-bf105eca-bc3d-4303-b97c-adbf0c8787e3 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-volume_attachments/b2f0d62b-ba81-4361-8238-57417c052465" status: 202 len: 0 microversion: 2.49 time: 0.275591 Apr 12 16:01:57 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 63/191] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 16:01:56 2023] DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-volume_attachments/b2f0d62b-ba81-4361-8238-57417c052465 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a81326c-a5ae-4b84-a746-2f4efd7335eb"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f75ebf76-12ce-4b6a-8582-c842f15bf6b2 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292225 Apr 12 16:01:58 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 65/192] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:01:58 2023] POST /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5894d073-fc1e-467b-99c4-290106eeea63"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:01:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:01:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f83ad43f-2a40-4495-8c27-2de4281dba36 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments/5403a600-a3bb-44d7-b9b8-bf933454ca76" status: 202 len: 0 microversion: 2.1 time: 0.543956 Apr 12 16:01:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 65/193] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 16:01:59 2023] PUT /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments/5403a600-a3bb-44d7-b9b8-bf933454ca76 => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-80084f5b-26ab-40bf-956d-0f0c04199362 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-interface/9e66bcb0-73bf-4d5e-b20a-b26443302fca" status: 202 len: 0 microversion: 2.49 time: 0.078299 Apr 12 16:02:00 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 64/194] 10.0.0.210 () {64 vars in 1507 bytes} [Wed Apr 12 16:02:00 2023] DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-interface/9e66bcb0-73bf-4d5e-b20a-b26443302fca => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c3e0bb23-534c-4ca3-8998-0337d8269976 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-instance-actions/req-80084f5b-26ab-40bf-956d-0f0c04199362" status: 200 len: 474 microversion: 2.49 time: 0.328485 Apr 12 16:02:00 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 66/195] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 16:02:00 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-instance-actions/req-80084f5b-26ab-40bf-956d-0f0c04199362 => generated 474 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:02:01 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-unplugged", "status": "completed", "tag": "9e66bcb0-73bf-4d5e-b20a-b26443302fca"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] Creating event network-vif-unplugged:9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:02:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-b695feaa-948b-4365-8871-83bebd497379 req-eb64799c-9413-44cc-9492-13773ced002a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031272 Apr 12 16:02:01 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 66/196] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:01 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:02:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1253aa1c-dae5-49b6-8414-ca615cf74b0e tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f" status: 204 len: 0 microversion: 2.1 time: 0.139144 Apr 12 16:02:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:02:01 2023] DELETE /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:01 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f405d698-81d4-4559-b666-40316b0ff0e8 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f" status: 200 len: 1491 microversion: 2.1 time: 0.203350 Apr 12 16:02:01 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:01 2023] GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f => generated 1491 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:02 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:03 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-plugged", "status": "completed", "tag": "9e66bcb0-73bf-4d5e-b20a-b26443302fca"}, {"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-deleted", "tag": "9e66bcb0-73bf-4d5e-b20a-b26443302fca"}, {"server_uuid": "abbb6742-17d0-46b3-87ba-c14abc06738f", "name": "network-vif-unplugged", "status": "completed", "tag": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9"}, {"server_uuid": "abbb6742-17d0-46b3-87ba-c14abc06738f", "name": "network-vif-plugged", "status": "completed", "tag": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9"}, {"server_uuid": "abbb6742-17d0-46b3-87ba-c14abc06738f", "name": "network-vif-deleted", "tag": "fb7d3715-f433-4db0-b9ac-8d5a2b0070e9"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:03 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-8d63f460-94bd-4961-a21c-7560bfbcb388 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872" status: 200 len: 1489 microversion: 2.1 time: 0.177018 Apr 12 16:02:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:02 2023] GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 => generated 1489 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Creating event network-vif-plugged:9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:02:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Creating event network-vif-deleted:9e66bcb0-73bf-4d5e-b20a-b26443302fca for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:02:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Creating event network-vif-unplugged:fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance abbb6742-17d0-46b3-87ba-c14abc06738f on user Apr 12 16:02:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Creating event network-vif-plugged:fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance abbb6742-17d0-46b3-87ba-c14abc06738f on user Apr 12 16:02:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] Creating event network-vif-deleted:fb7d3715-f433-4db0-b9ac-8d5a2b0070e9 for instance abbb6742-17d0-46b3-87ba-c14abc06738f on user Apr 12 16:02:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-40b9bc66-28ec-497b-af86-e711570804b9 req-7bf8308c-f3fa-42af-82d9-99704ab1fcbc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.047290 Apr 12 16:02:03 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 66/200] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:03 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d073941e-04d2-444a-8714-ff81ad8f4c0c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054019 Apr 12 16:02:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:06 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:06 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lazy-loading 'services' on Instance uuid 6614f2c0-399b-43d2-86c9-5790c57575e9 {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:02:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c3e6151d-f5af-4587-81d0-57b66680af7c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments/2a81326c-a5ae-4b84-a746-2f4efd7335eb" status: 202 len: 0 microversion: 2.1 time: 0.241580 Apr 12 16:02:06 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:02:06 2023] DELETE /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments/2a81326c-a5ae-4b84-a746-2f4efd7335eb => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:08 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-354bbcfc-ab49-4ab1-ba83-ab7a87e02a66 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1431 microversion: 2.1 time: 0.223321 Apr 12 16:02:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:08 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1431 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5b50fc94-b5bc-42f0-a4fe-958f9538e167 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069177 Apr 12 16:02:09 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 69/204] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:09 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-21067e71-e560-49b8-90e5-566ba28960e7 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058691 Apr 12 16:02:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 69/205] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:09 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:10 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:02:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2dcf5bde-1df7-4177-9431-f08101773965 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9" status: 204 len: 0 microversion: 2.1 time: 0.204099 Apr 12 16:02:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 68/206] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:02:09 2023] DELETE /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16ff4a8d98bc4dfa85f0f7d9c0fcebea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '672dcb2ce6454ab4aeae3de7550ca8e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:10 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-90a4d4d7-7c4e-483f-8608-856a9c41bbb9 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9" status: 200 len: 1668 microversion: 2.1 time: 0.286243 Apr 12 16:02:10 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:10 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 => generated 1668 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6614f2c0-399b-43d2-86c9-5790c57575e9", "name": "network-vif-unplugged", "status": "completed", "tag": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] Creating event network-vif-unplugged:f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 on user Apr 12 16:02:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-daf77724-679d-4e70-a5b1-4354ee8108dc req-dbee69f1-576e-4dc0-8d1b-050802dd5a0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039611 Apr 12 16:02:10 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 70/208] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] Creating event network-changed:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:02:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-70f4f74e-5d46-4419-9c86-d4e3299c1d1f req-4682f4bd-c773-4496-ba9b-a729b06b3bc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030207 Apr 12 16:02:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 69/209] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:10 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lazy-loading 'flavor' on Instance uuid 85b91251-9735-4812-9f11-003a7951a6f3 {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:02:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7688f8a1-1783-444a-82c4-fcc22539a47a tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3/action" status: 202 len: 0 microversion: 2.1 time: 0.173267 Apr 12 16:02:11 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 71/210] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:02:10 2023] POST /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:11 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-cf42c63c-287e-4904-8ce7-6a338216cfad tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1437 microversion: 2.1 time: 0.264730 Apr 12 16:02:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 71/211] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:11 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1437 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-unplugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:11 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] Creating event network-vif-unplugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:02:11 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-4610fd7d-29b8-4f6b-b512-fb0863117b43 req-d989edbf-40ad-4df6-b7fb-1ec9008fbe91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038513 Apr 12 16:02:11 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 70/212] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6614f2c0-399b-43d2-86c9-5790c57575e9", "name": "network-vif-plugged", "status": "completed", "tag": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] Creating event network-vif-plugged:f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 on user Apr 12 16:02:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-6c7a0256-f3c6-4914-aa7f-e3c3bd06cc20 req-d2e08b86-778d-45d0-9f2a-c605b68c35be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Apr 12 16:02:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 72/213] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-708e0767-e630-4d9b-901f-b19a46068971 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1657 microversion: 2.1 time: 0.541162 Apr 12 16:02:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 72/214] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:12 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1657 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7e33e85d-6581-4f9e-8dc7-94cdcba01b26 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045915 Apr 12 16:02:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 73/215] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:12 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-0325311e-7d9f-40cd-b5bb-baee7565393b tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045159 Apr 12 16:02:13 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 73/216] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:12 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "5403a600-a3bb-44d7-b9b8-bf933454ca76"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:13 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-07491762-876e-49f3-a1be-74b49d526348 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1657 microversion: 2.1 time: 0.181645 Apr 12 16:02:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 71/217] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:12 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1657 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-46c5e654-7b9b-4feb-bdfb-f5109e023e28 tempest-TestVolumeSwap-318995472 tempest-TestVolumeSwap-318995472-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments/5894d073-fc1e-467b-99c4-290106eeea63" status: 202 len: 0 microversion: 2.1 time: 0.308029 Apr 12 16:02:13 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 74/218] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 16:02:13 2023] PUT /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments/5894d073-fc1e-467b-99c4-290106eeea63 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:02:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}, {"server_uuid": "6614f2c0-399b-43d2-86c9-5790c57575e9", "name": "network-vif-deleted", "tag": "f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Creating event network-vif-plugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:02:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] Creating event network-vif-deleted:f1aab2a2-67f1-4ec5-9aeb-dffdec2170e3 for instance 6614f2c0-399b-43d2-86c9-5790c57575e9 on user Apr 12 16:02:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-494f037e-b2f5-4163-90eb-2429f1207562 req-bc12ebe1-be03-4e88-9dbc-4ca15ebd97b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043343 Apr 12 16:02:13 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:14 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] Creating event network-changed:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:02:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-6d574e0c-271a-4d6f-8180-f8bf14d2123d req-75660b79-ea22-43a9-8434-4536d8a52027 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031199 Apr 12 16:02:14 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 72/220] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:16 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:17 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:17 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:17 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-46daf400-25f6-4780-9cbe-d72bf1f10c6b tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 200 len: 1651 microversion: 2.20 time: 0.160324 Apr 12 16:02:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 75/221] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:02:16 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 1651 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:20 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-0440dc39-e5d7-4b69-8864-0a5e600322c2 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.184463 Apr 12 16:02:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 75/222] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 16:02:20 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c/os-interface => generated 1830 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-2141634890", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "b36306e0-04c5-4b1b-8022-05ff121c4e43"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:20 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] validate_networks() for [('b36306e0-04c5-4b1b-8022-05ff121c4e43', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for user 73f9fa5bc22a4824b3cdcb8cf7bb380c and project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:02:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:02:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2f9f654f-f62b-48ca-8866-c4756fbc06b3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.751283 Apr 12 16:02:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 73/223] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 16:02:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 16:02:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-fbf244be-fe2a-45f0-8cbd-4b8401fb3207 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:21 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-fbf244be-fe2a-45f0-8cbd-4b8401fb3207 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:21 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-fbf244be-fe2a-45f0-8cbd-4b8401fb3207 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:21 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-fbf244be-fe2a-45f0-8cbd-4b8401fb3207 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:21 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-fbf244be-fe2a-45f0-8cbd-4b8401fb3207 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-fbf244be-fe2a-45f0-8cbd-4b8401fb3207 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 200 len: 1395 microversion: 2.87 time: 0.118155 Apr 12 16:02:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 76/224] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:02:21 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 1395 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 12 16:02:21 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026ab036-1481-4689-af70-661493e9451c", "tag": "0d6194a7-a3c4-47f9-8c37-960cb622ce28"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] Creating event network-changed:0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-13d678f6-3429-4389-b7ed-952e98b53f30 req-1a63d5aa-50df-4e10-8b90-edcc5bb5c12a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050587 Apr 12 16:02:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 76/225] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-4e9f1f6d-1d58-46f6-9e50-71486983d52b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 200 len: 2828 microversion: 2.42 time: 0.317760 Apr 12 16:02:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 74/226] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:02:22 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 2828 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-ac5ca560-b7ce-4ead-bbc1-7044f28cc195 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.145909 Apr 12 16:02:22 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 77/227] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 16:02:22 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c/os-interface => generated 1830 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:23 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:02:23 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-cbf270ef-0c51-4bbf-9943-bfa7afa5681f tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 204 len: 0 microversion: 2.42 time: 0.154373 Apr 12 16:02:23 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 77/228] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:02:23 2023] DELETE /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:24 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:24 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:24 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '896a788283bf4e88b30528ef2721e90c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14aea401da6344858416fd2543bc10ca', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-ed494385-f1bc-4c16-9908-e54633e8242c tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 200 len: 2953 microversion: 2.42 time: 0.349530 Apr 12 16:02:24 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 75/229] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:02:23 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 2953 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-unplugged", "status": "completed", "tag": "0d6194a7-a3c4-47f9-8c37-960cb622ce28"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] Creating event network-vif-unplugged:0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-164c7a79-6279-4f0a-a300-cb4453db3fb2 req-8476164b-9664-453a-95c6-baf204b82291 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033079 Apr 12 16:02:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 78/230] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:24 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] Creating event network-changed:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:02:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-50f5a3ad-2c95-457a-b13d-28bcf58c2a6d req-59fa1a14-661d-49b6-a6b8-24bc15961546 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040045 Apr 12 16:02:24 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "0d6194a7-a3c4-47f9-8c37-960cb622ce28"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-unplugged", "status": "completed", "tag": "8ebc1d23-a473-4640-aa39-31cbed300c07"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "8ebc1d23-a473-4640-aa39-31cbed300c07"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-unplugged", "status": "completed", "tag": "7f36bae3-c729-4d85-8c31-075b2b100abe"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "7f36bae3-c729-4d85-8c31-075b2b100abe"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-unplugged", "status": "completed", "tag": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Creating event network-vif-plugged:0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Creating event network-vif-unplugged:8ebc1d23-a473-4640-aa39-31cbed300c07 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Creating event network-vif-plugged:8ebc1d23-a473-4640-aa39-31cbed300c07 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Creating event network-vif-unplugged:7f36bae3-c729-4d85-8c31-075b2b100abe for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Creating event network-vif-plugged:7f36bae3-c729-4d85-8c31-075b2b100abe for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Creating event network-vif-unplugged:264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] Creating event network-vif-plugged:264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d0861fb3-a200-4feb-b546-e94a1078b29e req-4af5d3ed-b139-4a10-9d5d-ca93fa54fc94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.074923 Apr 12 16:02:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1395 bytes} [Wed Apr 12 16:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d7bf0d62-a47f-4066-ab89-0e0e78717261 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.221419 Apr 12 16:02:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 76/233] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 16:02:26 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb/os-interface => generated 1829 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-61029d52-eb9e-4ed5-ae05-90ed66c054dc tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137672 Apr 12 16:02:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 79/234] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:26 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f72cc039-63f8-49ac-88ec-d750a0f04007 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068934 Apr 12 16:02:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 80/235] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:26 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-unplugged", "status": "completed", "tag": "e3f484fe-17dd-4cef-babd-ad78cf557b03"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "e3f484fe-17dd-4cef-babd-ad78cf557b03"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b2175eb-de94-4274-b200-14894dbcbda0"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "0b2175eb-de94-4274-b200-14894dbcbda0"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:27 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Creating event network-vif-unplugged:e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Creating event network-vif-plugged:e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Creating event network-vif-unplugged:0b2175eb-de94-4274-b200-14894dbcbda0 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] Creating event network-vif-plugged:0b2175eb-de94-4274-b200-14894dbcbda0 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-9ccdfa61-f35b-4279-b531-4d8451844c05 req-33930647-fcc9-4cc7-a414-7c4b1f9151e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.077549 Apr 12 16:02:27 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 77/236] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:26 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:27 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lazy-loading 'services' on Instance uuid e85aa869-0d2a-40ff-9697-f979a6b110cb {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:02:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-342a2ae6-74f9-4bb7-9699-ba22856fccf6 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments/5403a600-a3bb-44d7-b9b8-bf933454ca76" status: 202 len: 0 microversion: 2.1 time: 0.390433 Apr 12 16:02:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 80/237] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:02:27 2023] DELETE /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments/5403a600-a3bb-44d7-b9b8-bf933454ca76 => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-d3e2792d-cba0-42cc-aefe-bdbb3e532d31 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077242 Apr 12 16:02:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 81/238] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:02:27 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "tag": "7ae43e60-f63a-448e-9a89-0d6bff272104"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] Creating event network-changed:7ae43e60-f63a-448e-9a89-0d6bff272104 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-1d09ab23-6b37-47ef-ba11-3ddf071f897b req-14924870-33fc-436e-9212-e7dbb0410a67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053426 Apr 12 16:02:28 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 78/239] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:28 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-unplugged", "status": "completed", "tag": "5796cf52-4e81-4c40-954e-86819f5557c8"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-plugged", "status": "completed", "tag": "5796cf52-4e81-4c40-954e-86819f5557c8"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Creating event network-vif-unplugged:5796cf52-4e81-4c40-954e-86819f5557c8 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] Creating event network-vif-plugged:5796cf52-4e81-4c40-954e-86819f5557c8 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-62b6621c-9e5c-45a0-9f60-b16d6cc5b82f req-35d8dcac-6bb5-45d8-ac28-e8db19d59eb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.039039 Apr 12 16:02:28 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 82/240] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:28 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fe7a7770-e20f-4612-8ed2-31a7991f4a62 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 200 len: 2819 microversion: 2.32 time: 0.434484 Apr 12 16:02:28 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 81/241] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:02:28 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 2819 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d628837e-c13e-474c-ad5f-7bbe8a0f23cf tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.160900 Apr 12 16:02:28 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 79/242] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 16:02:28 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb/os-interface => generated 1829 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=40 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:29 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:02:30 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-eb3d82e7-7232-45a5-9d24-542563b8dec1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 204 len: 0 microversion: 2.32 time: 0.143223 Apr 12 16:02:30 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 83/243] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:02:29 2023] DELETE /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:30 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '51e8a84c876249dd9b588305926ffdff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '020f60d454f846d5a18dfbe1d88b65da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:30 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a2e26a91-9a8a-455f-b719-71c27ca09748 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 200 len: 2943 microversion: 2.32 time: 0.334822 Apr 12 16:02:30 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:02:30 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 2943 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:30 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-deleted", "tag": "0d6194a7-a3c4-47f9-8c37-960cb622ce28"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:30 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:30 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:30 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] Creating event network-vif-deleted:0d6194a7-a3c4-47f9-8c37-960cb622ce28 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-55ab6f1e-3f54-4c86-911f-13a8b18c0d52 req-5c93ffd3-f66a-492e-95ad-be1c35fa3f12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042063 Apr 12 16:02:30 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 80/245] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:30 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-unplugged", "status": "completed", "tag": "7ae43e60-f63a-448e-9a89-0d6bff272104"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:30 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] Creating event network-vif-unplugged:7ae43e60-f63a-448e-9a89-0d6bff272104 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:30 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-f080cfcc-d5f7-45df-a27d-e1f80b8e1a10 req-a7ce5acf-6100-401c-b79a-76ebdde95628 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039920 Apr 12 16:02:30 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 84/246] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:31 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-unplugged", "status": "completed", "tag": "b85b7f43-1f5d-441a-bf3e-380900194e10"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:31 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] Creating event network-vif-unplugged:b85b7f43-1f5d-441a-bf3e-380900194e10 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-8e3290df-8ee7-4ce5-b33f-c735dc3546a6 req-c2e130bb-b76c-4d14-a08d-d3a34b774b8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039288 Apr 12 16:02:31 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 83/247] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:32 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8b7bd1bf-f6ff-41d8-9552-96ec80a8b6bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190" status: 200 len: 1544 microversion: 2.1 time: 0.169614 Apr 12 16:02:32 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 81/248] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:32 2023] GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 => generated 1544 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:32 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-unplugged", "status": "completed", "tag": "6c9be856-3e7e-4166-8d71-a1f5330aa82f"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-deleted", "tag": "0b2175eb-de94-4274-b200-14894dbcbda0"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "6c9be856-3e7e-4166-8d71-a1f5330aa82f"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-unplugged", "status": "completed", "tag": "f76aae02-12c4-41d6-951a-201330ea7693"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "f76aae02-12c4-41d6-951a-201330ea7693"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-deleted", "tag": "e3f484fe-17dd-4cef-babd-ad78cf557b03"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:32 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Creating event network-vif-unplugged:6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Creating event network-vif-deleted:0b2175eb-de94-4274-b200-14894dbcbda0 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Creating event network-vif-plugged:6c9be856-3e7e-4166-8d71-a1f5330aa82f for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Creating event network-vif-unplugged:f76aae02-12c4-41d6-951a-201330ea7693 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Creating event network-vif-plugged:f76aae02-12c4-41d6-951a-201330ea7693 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] Creating event network-vif-deleted:e3f484fe-17dd-4cef-babd-ad78cf557b03 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-ce1d15aa-ff0f-48ed-a01e-7f740e53f05b req-6584da67-a422-4840-ad76-0a8da1aef47e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1042 microversion: 2.1 time: 0.052087 Apr 12 16:02:32 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 85/249] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 1042 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:32 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "7ae43e60-f63a-448e-9a89-0d6bff272104"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-unplugged", "status": "completed", "tag": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "cd2391ad-cb7a-47be-b062-b0dbbc1f8475"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Creating event network-vif-plugged:7ae43e60-f63a-448e-9a89-0d6bff272104 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Creating event network-vif-unplugged:cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] Creating event network-vif-plugged:cd2391ad-cb7a-47be-b062-b0dbbc1f8475 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-ce99b627-e8b1-45b0-9502-51fb6c7e756b req-24d66f32-cd4b-4ad7-9755-370352740dc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.047857 Apr 12 16:02:32 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:32 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "b85b7f43-1f5d-441a-bf3e-380900194e10"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-unplugged", "status": "completed", "tag": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-unplugged", "status": "completed", "tag": "1d70ad7b-92c6-47fa-a411-cef9d6159e90"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-plugged", "status": "completed", "tag": "1d70ad7b-92c6-47fa-a411-cef9d6159e90"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Creating event network-vif-plugged:b85b7f43-1f5d-441a-bf3e-380900194e10 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Creating event network-vif-unplugged:c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Creating event network-vif-plugged:c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Creating event network-vif-unplugged:1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] Creating event network-vif-plugged:1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-565ba1b4-e229-407e-9a88-eab4ecc34e5a req-8789015c-86b6-49bb-916c-16f2e11f9ad1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.032314 Apr 12 16:02:33 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 82/251] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:33 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:34 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-deleted", "tag": "264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b"}, {"server_uuid": "026ab036-1481-4689-af70-661493e9451c", "name": "network-vif-deleted", "tag": "5796cf52-4e81-4c40-954e-86819f5557c8"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] Creating event network-vif-deleted:264de72a-d4f4-4a6a-b3ab-1e8ea8b9a30b for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] Creating event network-vif-deleted:5796cf52-4e81-4c40-954e-86819f5557c8 for instance 026ab036-1481-4689-af70-661493e9451c on user Apr 12 16:02:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-035d6d27-91c2-48ef-97b1-79c2eb7d5c3f req-968d2c39-8648-4cbd-a965-872d0c04c9d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038162 Apr 12 16:02:34 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 86/252] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:36 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-deleted", "tag": "1d70ad7b-92c6-47fa-a411-cef9d6159e90"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-deleted", "tag": "b85b7f43-1f5d-441a-bf3e-380900194e10"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-deleted", "tag": "7ae43e60-f63a-448e-9a89-0d6bff272104"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-deleted", "tag": "f76aae02-12c4-41d6-951a-201330ea7693"}, {"server_uuid": "9ea56377-20bc-48cc-a248-5fad6db060cb", "name": "network-vif-deleted", "tag": "c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Creating event network-vif-deleted:1d70ad7b-92c6-47fa-a411-cef9d6159e90 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Creating event network-vif-deleted:b85b7f43-1f5d-441a-bf3e-380900194e10 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Creating event network-vif-deleted:7ae43e60-f63a-448e-9a89-0d6bff272104 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Creating event network-vif-deleted:f76aae02-12c4-41d6-951a-201330ea7693 for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] Creating event network-vif-deleted:c5c4abf8-1b9b-4385-adf7-b34b27a8bc6b for instance 9ea56377-20bc-48cc-a248-5fad6db060cb on user Apr 12 16:02:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-02a4ee7f-6da3-4a50-af23-211c650c02ed req-0306932e-fd08-4b1e-9444-974c4f31977a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.036536 Apr 12 16:02:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 85/253] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:36 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:37 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:02:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-2c80efc7-73cd-4797-aca3-6e541939387c req-64fabd45-4a34-4d62-a873-fb8b42a80e14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035999 Apr 12 16:02:37 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 83/254] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:02:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-583f5c5f-ca2f-43a2-a53c-489c436168b6 req-94ebbc23-b8ef-4983-95e7-8c3d2acc09c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036377 Apr 12 16:02:39 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 87/255] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=5 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-89b0b1b2-61e7-45ef-b9d8-d16d3011ed46 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-instance-actions/req-80084f5b-26ab-40bf-956d-0f0c04199362" status: 200 len: 503 microversion: 2.49 time: 0.049998 Apr 12 16:02:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 86/256] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 16:02:50 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-instance-actions/req-80084f5b-26ab-40bf-956d-0f0c04199362 => generated 503 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=13 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=37 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:50 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5614705a-caab-4cd3-9e5a-6a010a005089 tempest-TaggedAttachmentsTest-792491868 tempest-TaggedAttachmentsTest-792491868-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-instance-actions/req-80084f5b-26ab-40bf-956d-0f0c04199362" status: 200 len: 503 microversion: 2.49 time: 0.087942 Apr 12 16:02:50 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 84/257] 10.0.0.210 () {64 vars in 1537 bytes} [Wed Apr 12 16:02:50 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-instance-actions/req-80084f5b-26ab-40bf-956d-0f0c04199362 => generated 503 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-aa90b519-f8d5-4c6f-8053-5bb54768e8bb tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.047283 Apr 12 16:02:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 16:02:50 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:02:51 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5f435b00-6a1b-4899-9150-34d07cc2c5c6 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 204 len: 0 microversion: 2.49 time: 0.120152 Apr 12 16:02:51 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:02:51 2023] DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:51 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-unplugged", "status": "completed", "tag": "4a51084d-9fff-4a53-9387-4542bfd6a4a7"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:51 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '324eb9033e62405ca2b322bcb6da9a04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8197a98d7ebc4230899aca82b073ab15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] Creating event network-vif-unplugged:4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:02:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-72983661-5428-4a58-9457-e0ea2ea07c15 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 200 len: 1751 microversion: 2.49 time: 0.266819 Apr 12 16:02:51 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 85/260] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:02:51 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 1751 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:02:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-4287e954-c941-41ac-b584-663eb195eccf req-513f7b19-31a5-40ad-b966-c2cc21f33195 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033685 Apr 12 16:02:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 89/261] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:51 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: abbb6742-17d0-46b3-87ba-c14abc06738f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] HTTP exception thrown: Instance abbb6742-17d0-46b3-87ba-c14abc06738f could not be found. Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Request method failure captured: Apr 12 16:02:52 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f HTTP/1.1 Apr 12 16:02:52 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:02:52 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:02:52 user devstack@n-api.service[61657]: Connection: close Apr 12 16:02:52 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:02:52 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:02:52 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:02:52 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:02:52 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtWHCS9dVMf_WqXN7cu_QEvEfMYXmNL53uGfo4nJBd4KsbmggE1ZLiofLuydp6wKgZqqx0KWFcvHpgcMJROPVEL7eyGsLpyakInHr0nFblukHmHlOsrPH3QuebTSrJo_4HOT4yT3K8UtB6147FRDlXd_8vbEBKVzuFPBla_VpkZOHl0 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Project-Id: 1bde51ff8bde4dcdb14fcda0fc92d564 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Project-Name: tempest-VolumesActionsTest-104284977 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1bde51ff8bde4dcdb14fcda0fc92d564"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1bde51ff8bde4dcdb14fcda0fc92d564"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1bde51ff8bde4dcdb14fcda0fc92d564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Tenant: tempest-VolumesActionsTest-104284977 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Tenant-Id: 1bde51ff8bde4dcdb14fcda0fc92d564 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-VolumesActionsTest-104284977 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-User: tempest-VolumesActionsTest-104284977-project-member Apr 12 16:02:52 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:02:52 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:02:52 user devstack@n-api.service[61657]: X-User-Id: c5d01dd905404e4aa08a31f25fa53338 Apr 12 16:02:52 user devstack@n-api.service[61657]: X-User-Name: tempest-VolumesActionsTest-104284977-project-member Apr 12 16:02:52 user devstack@n-api.service[61657]: method: > Apr 12 16:02:52 user devstack@n-api.service[61657]: exception: Instance abbb6742-17d0-46b3-87ba-c14abc06738f could not be found. Apr 12 16:02:52 user devstack@n-api.service[61657]: action_args: {'id': 'abbb6742-17d0-46b3-87ba-c14abc06738f'} Apr 12 16:02:52 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abbb6742-17d0-46b3-87ba-c14abc06738f could not be found. Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abbb6742-17d0-46b3-87ba-c14abc06738f could not be found. Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abbb6742-17d0-46b3-87ba-c14abc06738f could not be found. Apr 12 16:02:52 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Returning 404 to user: Instance abbb6742-17d0-46b3-87ba-c14abc06738f could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:02:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1c3c3ec7-f347-4466-907a-238a01d42935 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f" status: 404 len: 111 microversion: 2.1 time: 0.035612 Apr 12 16:02:52 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 88/262] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:51 2023] GET /compute/v2.1/servers/abbb6742-17d0-46b3-87ba-c14abc06738f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1401858867", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "33052061-3a43-449e-b742-4ffa29dfc039"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] validate_networks() for [('33052061-3a43-449e-b742-4ffa29dfc039', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Getting quotas for project 1bde51ff8bde4dcdb14fcda0fc92d564. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Getting quotas for user c5d01dd905404e4aa08a31f25fa53338 and project 1bde51ff8bde4dcdb14fcda0fc92d564. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:02:52 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:02:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f958eef3-48e5-4601-83fb-2ecb7c81d669 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.508067 Apr 12 16:02:52 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 86/263] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:02:52 2023] POST /compute/v2.1/servers => generated 378 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:02:52 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e498a047-0e39-450d-a725-65e008138646 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:02:52 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e498a047-0e39-450d-a725-65e008138646 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:02:52 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-e498a047-0e39-450d-a725-65e008138646 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:02:52 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e498a047-0e39-450d-a725-65e008138646 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d" status: 200 len: 1208 microversion: 2.1 time: 0.069038 Apr 12 16:02:52 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 90/264] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:02:52 2023] GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d => generated 1208 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-98404061-31b7-4104-bb72-5226e3e41083 req-008fffcc-0f96-474e-8754-8a52fcdf0b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-deleted", "tag": "4a51084d-9fff-4a53-9387-4542bfd6a4a7"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-98404061-31b7-4104-bb72-5226e3e41083 req-008fffcc-0f96-474e-8754-8a52fcdf0b9f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-98404061-31b7-4104-bb72-5226e3e41083 req-008fffcc-0f96-474e-8754-8a52fcdf0b9f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-98404061-31b7-4104-bb72-5226e3e41083 req-008fffcc-0f96-474e-8754-8a52fcdf0b9f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-98404061-31b7-4104-bb72-5226e3e41083 req-008fffcc-0f96-474e-8754-8a52fcdf0b9f service nova] Creating event network-vif-deleted:4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:02:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-98404061-31b7-4104-bb72-5226e3e41083 req-008fffcc-0f96-474e-8754-8a52fcdf0b9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031889 Apr 12 16:02:52 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 89/265] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55aff314-eb5e-4752-af9f-a4021e970cac", "name": "network-vif-plugged", "status": "completed", "tag": "4a51084d-9fff-4a53-9387-4542bfd6a4a7"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] Creating event network-vif-plugged:4a51084d-9fff-4a53-9387-4542bfd6a4a7 for instance 55aff314-eb5e-4752-af9f-a4021e970cac on user Apr 12 16:02:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-bf0daa3f-7e45-4513-a30f-f59371fa814f req-74ee7d8c-30b6-4a8b-8c13-3b79442c36d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032133 Apr 12 16:02:53 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 87/266] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2285eef6-6613-4802-a988-3fae065fa92d", "tag": "56615a48-49c1-42dd-8326-5806056ea7cf"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] Creating event network-changed:56615a48-49c1-42dd-8326-5806056ea7cf for instance 2285eef6-6613-4802-a988-3fae065fa92d on user Apr 12 16:02:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-cd8348d7-4706-436f-b1b7-bb97c1c60e51 req-373e6f90-6ec1-4766-94e0-b5cf72a52fbf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033736 Apr 12 16:02:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 91/267] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:57 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285eef6-6613-4802-a988-3fae065fa92d", "name": "network-vif-plugged", "status": "completed", "tag": "56615a48-49c1-42dd-8326-5806056ea7cf"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:57 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] Creating event network-vif-plugged:56615a48-49c1-42dd-8326-5806056ea7cf for instance 2285eef6-6613-4802-a988-3fae065fa92d on user Apr 12 16:02:57 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-f3a55ea4-db3c-464c-8bf5-4c9390bec283 req-40f4f9f3-f715-4f39-8c39-90aad5382c2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033333 Apr 12 16:02:57 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 90/268] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:02:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285eef6-6613-4802-a988-3fae065fa92d", "name": "network-vif-plugged", "status": "completed", "tag": "56615a48-49c1-42dd-8326-5806056ea7cf"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:02:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:02:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:02:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:02:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] Creating event network-vif-plugged:56615a48-49c1-42dd-8326-5806056ea7cf for instance 2285eef6-6613-4802-a988-3fae065fa92d on user Apr 12 16:02:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-56333c9b-5b6d-4264-9fe4-826648366ce4 req-d6a61920-7ee9-4afa-b93c-4ed966ec9c26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031822 Apr 12 16:02:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 88/269] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:02:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] HTTP exception thrown: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Request method failure captured: Apr 12 16:03:00 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 HTTP/1.1 Apr 12 16:03:00 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:03:00 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:03:00 user devstack@n-api.service[61658]: Connection: close Apr 12 16:03:00 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:03:00 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:03:00 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:03:00 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:03:00 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVeQH5XyAp4WAxygHwvbttvm9c7EXAhqoav3GzzRj13iVoEzkz2C2e64bvzuZB_Dn6Cj_EJyqwJcO8HwSKri8PAkJokwF1ZyVgOIlQrfkphB-e1aR7fY0GWbMmWRTYo6Nc3i3pwum6h7Utl4us55m_EVIbKiLn50R-wVcq2NXyjkPU Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Project-Id: 672dcb2ce6454ab4aeae3de7550ca8e0 Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Tenant-Id: 672dcb2ce6454ab4aeae3de7550ca8e0 Apr 12 16:03:00 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:00 user devstack@n-api.service[61658]: X-User: tempest-AttachSCSIVolumeTestJSON-526027473-project-member Apr 12 16:03:00 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:03:00 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:03:00 user devstack@n-api.service[61658]: X-User-Id: 16ff4a8d98bc4dfa85f0f7d9c0fcebea Apr 12 16:03:00 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-526027473-project-member Apr 12 16:03:00 user devstack@n-api.service[61658]: method: > Apr 12 16:03:00 user devstack@n-api.service[61658]: exception: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:00 user devstack@n-api.service[61658]: action_args: {'id': '6614f2c0-399b-43d2-86c9-5790c57575e9'} Apr 12 16:03:00 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Returning 404 to user: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f1a10d7f-8a6a-46a6-bd32-e91a1201c4ac tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9" status: 404 len: 111 microversion: 2.1 time: 0.045047 Apr 12 16:03:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 92/270] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:00 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:03:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d05f9609-6c51-42dd-8dea-cfc4728884f3 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '.version_select at 0x7fdee78bab00>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d05f9609-6c51-42dd-8dea-cfc4728884f3 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-393786" status: 202 len: 0 microversion: 2.1 time: 0.026711 Apr 12 16:03:00 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1286 bytes} [Wed Apr 12 16:03:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-393786 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:01 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6d0b88c5-ba3c-46b0-9679-15623be39896 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1497 microversion: 2.1 time: 0.157210 Apr 12 16:03:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 89/272] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:01 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:03 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-72c09a40-4000-469b-83e8-c0c83be29715 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 200 len: 1504 microversion: 2.1 time: 0.163924 Apr 12 16:03:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 93/273] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:03 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] HTTP exception thrown: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Request method failure captured: Apr 12 16:03:03 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 HTTP/1.1 Apr 12 16:03:03 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:03:03 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:03:03 user devstack@n-api.service[61657]: Connection: close Apr 12 16:03:03 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:03:03 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:03:03 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:03:03 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:03:03 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVeQH5XyAp4WAxygHwvbttvm9c7EXAhqoav3GzzRj13iVoEzkz2C2e64bvzuZB_Dn6Cj_EJyqwJcO8HwSKri8PAkJokwF1ZyVgOIlQrfkphB-e1aR7fY0GWbMmWRTYo6Nc3i3pwum6h7Utl4us55m_EVIbKiLn50R-wVcq2NXyjkPU Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Project-Id: 672dcb2ce6454ab4aeae3de7550ca8e0 Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Tenant-Id: 672dcb2ce6454ab4aeae3de7550ca8e0 Apr 12 16:03:03 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:03 user devstack@n-api.service[61657]: X-User: tempest-AttachSCSIVolumeTestJSON-526027473-project-member Apr 12 16:03:03 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:03:03 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:03:03 user devstack@n-api.service[61657]: X-User-Id: 16ff4a8d98bc4dfa85f0f7d9c0fcebea Apr 12 16:03:03 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-526027473-project-member Apr 12 16:03:03 user devstack@n-api.service[61657]: method: > Apr 12 16:03:03 user devstack@n-api.service[61657]: exception: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61657]: action_args: {'id': '6614f2c0-399b-43d2-86c9-5790c57575e9'} Apr 12 16:03:03 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Returning 404 to user: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f2103407-9c07-43b7-a571-a3bbc4adcd90 tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9" status: 404 len: 111 microversion: 2.1 time: 0.041508 Apr 12 16:03:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 92/274] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:03:03 2023] DELETE /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] [instance: 6614f2c0-399b-43d2-86c9-5790c57575e9] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] HTTP exception thrown: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Request method failure captured: Apr 12 16:03:03 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 HTTP/1.1 Apr 12 16:03:03 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:03:03 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:03:03 user devstack@n-api.service[61659]: Connection: close Apr 12 16:03:03 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:03:03 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:03:03 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:03:03 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:03:03 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVeQH5XyAp4WAxygHwvbttvm9c7EXAhqoav3GzzRj13iVoEzkz2C2e64bvzuZB_Dn6Cj_EJyqwJcO8HwSKri8PAkJokwF1ZyVgOIlQrfkphB-e1aR7fY0GWbMmWRTYo6Nc3i3pwum6h7Utl4us55m_EVIbKiLn50R-wVcq2NXyjkPU Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Project-Id: 672dcb2ce6454ab4aeae3de7550ca8e0 Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/672dcb2ce6454ab4aeae3de7550ca8e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Tenant-Id: 672dcb2ce6454ab4aeae3de7550ca8e0 Apr 12 16:03:03 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-526027473 Apr 12 16:03:03 user devstack@n-api.service[61659]: X-User: tempest-AttachSCSIVolumeTestJSON-526027473-project-member Apr 12 16:03:03 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:03:03 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:03:03 user devstack@n-api.service[61659]: X-User-Id: 16ff4a8d98bc4dfa85f0f7d9c0fcebea Apr 12 16:03:03 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-526027473-project-member Apr 12 16:03:03 user devstack@n-api.service[61659]: method: > Apr 12 16:03:03 user devstack@n-api.service[61659]: exception: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61659]: action_args: {'id': '6614f2c0-399b-43d2-86c9-5790c57575e9'} Apr 12 16:03:03 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. Apr 12 16:03:03 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:03 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] Returning 404 to user: Instance 6614f2c0-399b-43d2-86c9-5790c57575e9 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-ea2f6732-b03e-4d13-8355-cb3b2592e17c tempest-AttachSCSIVolumeTestJSON-526027473 tempest-AttachSCSIVolumeTestJSON-526027473-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9" status: 404 len: 111 microversion: 2.1 time: 0.034806 Apr 12 16:03:03 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 90/275] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:03 2023] GET /compute/v2.1/servers/6614f2c0-399b-43d2-86c9-5790c57575e9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:12 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:12 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:12 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7b75f970-09c4-4164-9ac8-1320785060cc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 200 len: 1769 microversion: 2.87 time: 0.198604 Apr 12 16:03:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 94/276] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:11 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 1769 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] HTTP exception thrown: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Request method failure captured: Apr 12 16:03:14 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c HTTP/1.1 Apr 12 16:03:14 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:03:14 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:03:14 user devstack@n-api.service[61657]: Connection: close Apr 12 16:03:14 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:03:14 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:03:14 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:03:14 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:03:14 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVdEuI3QksEgAJR_h4CaM7uKOOPFVZi2STJL90-y3QBic1nRRBXvAzImHwscPVJjZv8DNiKF6MU0XNOkBYLgKOGkM6A0KzTv-fCkRK33THp_Z3FplHOqyWMJ3D937z2YQjl7eeFCYyk9cU81Uk4ZgHJ3CzAeuowdLPAXHh9yYiLTUE Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Project-Id: 14aea401da6344858416fd2543bc10ca Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14aea401da6344858416fd2543bc10ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14aea401da6344858416fd2543bc10ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14aea401da6344858416fd2543bc10ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Tenant-Id: 14aea401da6344858416fd2543bc10ca Apr 12 16:03:14 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:14 user devstack@n-api.service[61657]: X-User: tempest-TaggedBootDevicesTest_v242-1488698683-project-member Apr 12 16:03:14 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:03:14 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:03:14 user devstack@n-api.service[61657]: X-User-Id: 896a788283bf4e88b30528ef2721e90c Apr 12 16:03:14 user devstack@n-api.service[61657]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1488698683-project-member Apr 12 16:03:14 user devstack@n-api.service[61657]: method: > Apr 12 16:03:14 user devstack@n-api.service[61657]: exception: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:14 user devstack@n-api.service[61657]: action_args: {'id': '026ab036-1481-4689-af70-661493e9451c'} Apr 12 16:03:14 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Returning 404 to user: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e8861e1c-c17d-4b09-b38d-d822eb5e357b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 404 len: 111 microversion: 2.42 time: 0.040035 Apr 12 16:03:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 93/277] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:14 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:14 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b210e784-79ba-4ce3-833d-39e720a9c3ca tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '.version_select at 0x7fdee78e4f70>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:14 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:14 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=28 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b210e784-79ba-4ce3-833d-39e720a9c3ca tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782217974" status: 204 len: 0 microversion: 2.42 time: 0.048588 Apr 12 16:03:14 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 91/278] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 16:03:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1782217974 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:14 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-cde19721-7853-4da3-b0d5-f5e9146a1268 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1657 microversion: 2.1 time: 0.140376 Apr 12 16:03:14 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 95/279] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:14 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1657 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b09d128a-0198-4cfc-942f-323bd2f41d53"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:15 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-46f59941-1599-44d5-b082-e835e0d14bce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334852 Apr 12 16:03:15 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 94/280] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:03:14 2023] POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfd27585-75c7-4a04-a93a-79e4236a36f7"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-85fed989-f91c-49ec-9662-8ea08f3ee2dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.391282 Apr 12 16:03:17 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 92/281] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 16:03:17 2023] POST /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments => generated 188 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61658) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 16:03:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c896af91-6dad-4376-af54-66b6a1ebe299 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076087 Apr 12 16:03:17 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:03:17 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:03:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-a93c5be7-6c20-4ded-9f78-3eae721683f5 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/action" status: 202 len: 0 microversion: 2.20 time: 0.137272 Apr 12 16:03:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 96/283] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:03:17 2023] POST /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/action => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:17 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:03:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-106906fa-3ae8-4042-bc3b-d928c6c416aa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb" status: 204 len: 0 microversion: 2.1 time: 0.197473 Apr 12 16:03:17 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:03:17 2023] DELETE /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:18 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:18 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:18 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f94bbf49-ab01-41b8-a696-afe4c3dfcab9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 200 len: 1737 microversion: 2.20 time: 0.299950 Apr 12 16:03:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 93/285] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:17 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 1737 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:03:18 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2e5f900d0b144f9942de733017fb396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8e21d4dae04fd08951f8306cff0624', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-24ef0b95-1251-4e79-b58e-06822c3c68e0 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb" status: 200 len: 1652 microversion: 2.1 time: 0.217771 Apr 12 16:03:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 97/286] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:17 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb => generated 1652 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:03:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "name": "network-vif-unplugged", "status": "completed", "tag": "0db939d7-60c3-48af-8d8d-0f5528f41bb6"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] Creating event network-vif-unplugged:0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb on user Apr 12 16:03:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-85e013e3-4e2f-4002-b44c-8a790740b626 req-650d50b1-76bc-47da-94b0-c607ef988222 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040957 Apr 12 16:03:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 97/287] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:19 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] HTTP exception thrown: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Request method failure captured: Apr 12 16:03:19 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c HTTP/1.1 Apr 12 16:03:19 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:03:19 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:03:19 user devstack@n-api.service[61659]: Connection: close Apr 12 16:03:19 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:03:19 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:03:19 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:03:19 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:03:19 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVdEuI3QksEgAJR_h4CaM7uKOOPFVZi2STJL90-y3QBic1nRRBXvAzImHwscPVJjZv8DNiKF6MU0XNOkBYLgKOGkM6A0KzTv-fCkRK33THp_Z3FplHOqyWMJ3D937z2YQjl7eeFCYyk9cU81Uk4ZgHJ3CzAeuowdLPAXHh9yYiLTUE Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Project-Id: 14aea401da6344858416fd2543bc10ca Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14aea401da6344858416fd2543bc10ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14aea401da6344858416fd2543bc10ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14aea401da6344858416fd2543bc10ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Tenant-Id: 14aea401da6344858416fd2543bc10ca Apr 12 16:03:19 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:19 user devstack@n-api.service[61659]: X-User: tempest-TaggedBootDevicesTest_v242-1488698683-project-member Apr 12 16:03:19 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:03:19 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:03:19 user devstack@n-api.service[61659]: X-User-Id: 896a788283bf4e88b30528ef2721e90c Apr 12 16:03:19 user devstack@n-api.service[61659]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1488698683-project-member Apr 12 16:03:19 user devstack@n-api.service[61659]: method: > Apr 12 16:03:19 user devstack@n-api.service[61659]: exception: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61659]: action_args: {'id': '026ab036-1481-4689-af70-661493e9451c'} Apr 12 16:03:19 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Returning 404 to user: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:19 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8d313ed3-13e7-4452-a915-ef016e4ab497 tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 404 len: 111 microversion: 2.42 time: 0.044393 Apr 12 16:03:19 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 94/288] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:03:19 2023] DELETE /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] [instance: 026ab036-1481-4689-af70-661493e9451c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:19 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] HTTP exception thrown: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Request method failure captured: Apr 12 16:03:19 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c HTTP/1.1 Apr 12 16:03:19 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:03:19 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:03:19 user devstack@n-api.service[61658]: Connection: close Apr 12 16:03:19 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:03:19 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:03:19 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:03:19 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:03:19 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVdEuI3QksEgAJR_h4CaM7uKOOPFVZi2STJL90-y3QBic1nRRBXvAzImHwscPVJjZv8DNiKF6MU0XNOkBYLgKOGkM6A0KzTv-fCkRK33THp_Z3FplHOqyWMJ3D937z2YQjl7eeFCYyk9cU81Uk4ZgHJ3CzAeuowdLPAXHh9yYiLTUE Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.42 Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Project-Id: 14aea401da6344858416fd2543bc10ca Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/14aea401da6344858416fd2543bc10ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14aea401da6344858416fd2543bc10ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/14aea401da6344858416fd2543bc10ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Tenant-Id: 14aea401da6344858416fd2543bc10ca Apr 12 16:03:19 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1488698683 Apr 12 16:03:19 user devstack@n-api.service[61658]: X-User: tempest-TaggedBootDevicesTest_v242-1488698683-project-member Apr 12 16:03:19 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:03:19 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:03:19 user devstack@n-api.service[61658]: X-User-Id: 896a788283bf4e88b30528ef2721e90c Apr 12 16:03:19 user devstack@n-api.service[61658]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1488698683-project-member Apr 12 16:03:19 user devstack@n-api.service[61658]: method: > Apr 12 16:03:19 user devstack@n-api.service[61658]: exception: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61658]: action_args: {'id': '026ab036-1481-4689-af70-661493e9451c'} Apr 12 16:03:19 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. Apr 12 16:03:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] Returning 404 to user: Instance 026ab036-1481-4689-af70-661493e9451c could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:19 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-a8c30507-f1bf-47d2-a645-c4f8d2bc5d5b tempest-TaggedBootDevicesTest_v242-1488698683 tempest-TaggedBootDevicesTest_v242-1488698683-project-member] 10.0.0.210 "GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c" status: 404 len: 111 microversion: 2.42 time: 0.038104 Apr 12 16:03:19 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 98/289] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:19 2023] GET /compute/v2.1/servers/026ab036-1481-4689-af70-661493e9451c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "name": "network-vif-deleted", "tag": "0db939d7-60c3-48af-8d8d-0f5528f41bb6"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] Creating event network-vif-deleted:0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb on user Apr 12 16:03:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-67ad8188-a5e5-4271-8768-5b8f4b2d30fe req-a7c99b07-493e-441f-9ddf-a37cddbe38a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046228 Apr 12 16:03:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 98/290] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85aa869-0d2a-40ff-9697-f979a6b110cb", "name": "network-vif-plugged", "status": "completed", "tag": "0db939d7-60c3-48af-8d8d-0f5528f41bb6"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] Creating event network-vif-plugged:0db939d7-60c3-48af-8d8d-0f5528f41bb6 for instance e85aa869-0d2a-40ff-9697-f979a6b110cb on user Apr 12 16:03:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-363f83b3-0a86-41de-bdbc-381553c9a307 req-00be2ea7-600c-4097-943d-299e66258b43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035092 Apr 12 16:03:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 95/291] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] HTTP exception thrown: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Request method failure captured: Apr 12 16:03:20 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb HTTP/1.1 Apr 12 16:03:20 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:03:20 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:03:20 user devstack@n-api.service[61658]: Connection: close Apr 12 16:03:20 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:03:20 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:03:20 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:03:20 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:03:20 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVkDTQyMhFi-D58RL1MCdeGFFdjG-biX1oUNqJXHZq8O1Q9fiOwYA4IA09lcpbsJxnzr63ZV_NtqYKzpu7XTmWAqlD4DGKEAOcv16tCIWCOnU3FI3rPQ6qiV3AGTUEQ7n4vtKTammnWhlgDdT6ELmkkQVT2eFVvxy8rG4aRrsmxmkA Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Project-Id: 020f60d454f846d5a18dfbe1d88b65da Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Project-Name: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Tenant: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Tenant-Id: 020f60d454f846d5a18dfbe1d88b65da Apr 12 16:03:20 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:20 user devstack@n-api.service[61658]: X-User: tempest-TaggedBootDevicesTest-42052269-project-member Apr 12 16:03:20 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:03:20 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:03:20 user devstack@n-api.service[61658]: X-User-Id: 51e8a84c876249dd9b588305926ffdff Apr 12 16:03:20 user devstack@n-api.service[61658]: X-User-Name: tempest-TaggedBootDevicesTest-42052269-project-member Apr 12 16:03:20 user devstack@n-api.service[61658]: method: > Apr 12 16:03:20 user devstack@n-api.service[61658]: exception: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:20 user devstack@n-api.service[61658]: action_args: {'id': '9ea56377-20bc-48cc-a248-5fad6db060cb'} Apr 12 16:03:20 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Returning 404 to user: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-dd702216-fb5c-4b5f-8864-b2848b40c3b1 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 404 len: 111 microversion: 2.32 time: 0.042195 Apr 12 16:03:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 99/292] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:20 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-2afcc7bb-b1df-478c-b0fa-0f010d97e4c8 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '.version_select at 0x7fdee7bce0e0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-2afcc7bb-b1df-478c-b0fa-0f010d97e4c8 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302611627" status: 204 len: 0 microversion: 2.32 time: 0.045386 Apr 12 16:03:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 99/293] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 16:03:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302611627 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:23 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-fa70259f-0dd1-4333-863e-5612b0b2c6c1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1703 microversion: 2.1 time: 0.264905 Apr 12 16:03:23 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 96/294] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:22 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1703 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-416657090", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for project 97ea81bd1962466bbe552424973f71a8. Resources: dict_keys(['metadata_items']) {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for user 1a699b3ba8304eadb8a53d465ea340cf and project 97ea81bd1962466bbe552424973f71a8. Resources: dict_keys(['metadata_items']) {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-47008d17-dec1-4675-ae9a-14093137fa11 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/action" status: 202 len: 1158 microversion: 2.1 time: 0.465449 Apr 12 16:03:23 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 100/295] 10.0.0.210 () {64 vars in 1356 bytes} [Wed Apr 12 16:03:23 2023] POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/action => generated 1158 bytes in 468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:23 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:23 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e9ecf5da-15fb-45a5-9fe1-48e289ee4352 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1730 microversion: 2.1 time: 0.252160 Apr 12 16:03:23 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 100/296] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:23 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1730 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] HTTP exception thrown: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Request method failure captured: Apr 12 16:03:24 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb HTTP/1.1 Apr 12 16:03:24 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:03:24 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:03:24 user devstack@n-api.service[61659]: Connection: close Apr 12 16:03:24 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:03:24 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:03:24 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:03:24 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:03:24 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVkDTQyMhFi-D58RL1MCdeGFFdjG-biX1oUNqJXHZq8O1Q9fiOwYA4IA09lcpbsJxnzr63ZV_NtqYKzpu7XTmWAqlD4DGKEAOcv16tCIWCOnU3FI3rPQ6qiV3AGTUEQ7n4vtKTammnWhlgDdT6ELmkkQVT2eFVvxy8rG4aRrsmxmkA Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Project-Id: 020f60d454f846d5a18dfbe1d88b65da Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Project-Name: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Tenant: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Tenant-Id: 020f60d454f846d5a18dfbe1d88b65da Apr 12 16:03:24 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:24 user devstack@n-api.service[61659]: X-User: tempest-TaggedBootDevicesTest-42052269-project-member Apr 12 16:03:24 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:03:24 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:03:24 user devstack@n-api.service[61659]: X-User-Id: 51e8a84c876249dd9b588305926ffdff Apr 12 16:03:24 user devstack@n-api.service[61659]: X-User-Name: tempest-TaggedBootDevicesTest-42052269-project-member Apr 12 16:03:24 user devstack@n-api.service[61659]: method: > Apr 12 16:03:24 user devstack@n-api.service[61659]: exception: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61659]: action_args: {'id': '9ea56377-20bc-48cc-a248-5fad6db060cb'} Apr 12 16:03:24 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Returning 404 to user: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-9ba7c13c-974e-498f-a492-8ad188df7922 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 404 len: 111 microversion: 2.32 time: 0.037778 Apr 12 16:03:24 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 97/297] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:03:24 2023] DELETE /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] [instance: 9ea56377-20bc-48cc-a248-5fad6db060cb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] HTTP exception thrown: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Request method failure captured: Apr 12 16:03:24 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb HTTP/1.1 Apr 12 16:03:24 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:03:24 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:03:24 user devstack@n-api.service[61658]: Connection: close Apr 12 16:03:24 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:03:24 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:03:24 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:03:24 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:03:24 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVkDTQyMhFi-D58RL1MCdeGFFdjG-biX1oUNqJXHZq8O1Q9fiOwYA4IA09lcpbsJxnzr63ZV_NtqYKzpu7XTmWAqlD4DGKEAOcv16tCIWCOnU3FI3rPQ6qiV3AGTUEQ7n4vtKTammnWhlgDdT6ELmkkQVT2eFVvxy8rG4aRrsmxmkA Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.32 Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Project-Id: 020f60d454f846d5a18dfbe1d88b65da Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Project-Name: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/020f60d454f846d5a18dfbe1d88b65da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Tenant: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Tenant-Id: 020f60d454f846d5a18dfbe1d88b65da Apr 12 16:03:24 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TaggedBootDevicesTest-42052269 Apr 12 16:03:24 user devstack@n-api.service[61658]: X-User: tempest-TaggedBootDevicesTest-42052269-project-member Apr 12 16:03:24 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:03:24 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:03:24 user devstack@n-api.service[61658]: X-User-Id: 51e8a84c876249dd9b588305926ffdff Apr 12 16:03:24 user devstack@n-api.service[61658]: X-User-Name: tempest-TaggedBootDevicesTest-42052269-project-member Apr 12 16:03:24 user devstack@n-api.service[61658]: method: > Apr 12 16:03:24 user devstack@n-api.service[61658]: exception: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61658]: action_args: {'id': '9ea56377-20bc-48cc-a248-5fad6db060cb'} Apr 12 16:03:24 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. Apr 12 16:03:24 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] Returning 404 to user: Instance 9ea56377-20bc-48cc-a248-5fad6db060cb could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-23463f87-3d43-4e8c-b651-bcba2f7857e3 tempest-TaggedBootDevicesTest-42052269 tempest-TaggedBootDevicesTest-42052269-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb" status: 404 len: 111 microversion: 2.32 time: 0.054259 Apr 12 16:03:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 101/298] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:24 2023] GET /compute/v2.1/servers/9ea56377-20bc-48cc-a248-5fad6db060cb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:24 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] Creating event network-vif-unplugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:03:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-c21df7d4-1a48-4fa1-9f3b-ccd712fd305d req-e109cf3d-2ade-4631-91fe-8e7397437ad8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085570 Apr 12 16:03:24 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 101/299] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:03:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-2038068d-e803-4d3a-b5d8-3b5c72f894c6 req-8669e4ac-8ac8-4d31-b56d-78e268e48c54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065044 Apr 12 16:03:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 98/300] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:28 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] Creating event network-changed:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:03:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-da1699ef-fe6a-42bb-9951-f28b433b984b req-35cf21b2-2df9-43e9-b8ad-571981ebbf31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042240 Apr 12 16:03:28 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 102/301] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:31 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e6f68966-f439-41b6-9a95-afebbd073611 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Action: 'create', calling method: .version_select at 0x7fdee78bba30>, body: {"keypair": {"name": "tempest-keypair-2119173920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5iGnI/5QUzaemWuPuISz6DoXlthOLrvHmO1ttnNkpfWuy+j+rfVtjrZ0Ne2wROK5ZFJtWT+9pJ5d8Q3gkQxpaFURoacMo45jMZIUZeh23Z6htw6S217IIzKdvKFzW0yA=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:31 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-e6f68966-f439-41b6-9a95-afebbd073611 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting quotas for project 76f559719f5f43c3a47a0aaf1e699193. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:03:31 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-e6f68966-f439-41b6-9a95-afebbd073611 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting quotas for user 2b65791f14d34508b8a9a0849a9bf89e and project 76f559719f5f43c3a47a0aaf1e699193. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:03:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e6f68966-f439-41b6-9a95-afebbd073611 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.333040 Apr 12 16:03:31 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 102/302] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:03:31 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-af69d21d-583f-4956-bdf0-7ca21d411932 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.441312 Apr 12 16:03:32 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 99/303] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:03:32 2023] GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190/os-interface => generated 283 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad0cece6-9b26-4c87-9e48-2c0437cb9190", "tag": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] Creating event network-changed:b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 on user Apr 12 16:03:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-916e6eb9-e257-4cda-b862-48636bd77ae2 req-c7e4fa53-52df-4f09-b7f0-eca6d1c23759 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036639 Apr 12 16:03:34 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 103/304] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-760c3f12-2dcd-4369-aace-e9162faaf9ba tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190/ips" status: 200 len: 108 microversion: 2.1 time: 0.043339 Apr 12 16:03:34 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 103/305] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:03:34 2023] GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190/ips => generated 108 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d4e6a19-342a-43eb-b9dc-9570b802fbe6"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Invalid volume: volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 is already attached to instances: 920c6512-180d-46e1-b0cf-240d34c3fc97 Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:03:34 user devstack@n-api.service[61659]: request: POST /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190/os-volume_attachments HTTP/1.1 Apr 12 16:03:34 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:03:34 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:03:34 user devstack@n-api.service[61659]: Connection: close Apr 12 16:03:34 user devstack@n-api.service[61659]: Content-Length: 74 Apr 12 16:03:34 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:03:34 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:03:34 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:03:34 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:03:34 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:03:34 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:03:34 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:03:34 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:03:34 user devstack@n-api.service[61659]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:03:34 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:03:34 user devstack@n-api.service[61659]: Apr 12 16:03:34 user devstack@n-api.service[61659]: {"volumeAttachment": {"volumeId": "8d4e6a19-342a-43eb-b9dc-9570b802fbe6"}} Apr 12 16:03:34 user devstack@n-api.service[61659]: method: > Apr 12 16:03:34 user devstack@n-api.service[61659]: exception: Invalid volume: volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 is already attached to instances: 920c6512-180d-46e1-b0cf-240d34c3fc97 Apr 12 16:03:34 user devstack@n-api.service[61659]: action_args: {'server_id': 'ad0cece6-9b26-4c87-9e48-2c0437cb9190', 'body': {'volumeAttachment': {'volumeId': '8d4e6a19-342a-43eb-b9dc-9570b802fbe6'}}} Apr 12 16:03:34 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 is already attached to instances: 920c6512-180d-46e1-b0cf-240d34c3fc97 Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 is already attached to instances: 920c6512-180d-46e1-b0cf-240d34c3fc97 Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 is already attached to instances: 920c6512-180d-46e1-b0cf-240d34c3fc97 Apr 12 16:03:34 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 400 to user: Invalid volume: volume 8d4e6a19-342a-43eb-b9dc-9570b802fbe6 is already attached to instances: 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:34 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-20ff22e0-54e8-40b6-9d86-956d88fb0ae1 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.129627 Apr 12 16:03:34 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 100/306] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:03:34 2023] POST /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190/os-volume_attachments => generated 174 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-619835956", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f"}], "security_groups": [{"name": "tempest-securitygroup--2780347"}], "key_name": "tempest-keypair-2119173920", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:34 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:03:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6348be2b-b3c4-4a5d-8ef5-be94edc1af79 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190" status: 204 len: 0 microversion: 2.1 time: 0.194231 Apr 12 16:03:34 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 104/307] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:03:34 2023] DELETE /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] validate_networks() for [('0a97bb8e-9c19-41f1-bfcd-428e3ea3492f', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:34 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-89f157a5-c163-46ad-b2f1-c171db77a570 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190" status: 200 len: 1550 microversion: 2.1 time: 0.276067 Apr 12 16:03:34 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 101/308] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:34 2023] GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 => generated 1550 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting quotas for project 76f559719f5f43c3a47a0aaf1e699193. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting quotas for user 2b65791f14d34508b8a9a0849a9bf89e and project 76f559719f5f43c3a47a0aaf1e699193. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:03:34 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:03:35 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f9137bed-fd6d-492e-bd2b-f5611b5b6548 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.645878 Apr 12 16:03:35 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:03:34 2023] POST /compute/v2.1/servers => generated 401 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:03:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-804902b1-d97e-4fae-98f3-1502afb6e607 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-804902b1-d97e-4fae-98f3-1502afb6e607 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:35 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-804902b1-d97e-4fae-98f3-1502afb6e607 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-804902b1-d97e-4fae-98f3-1502afb6e607 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" status: 200 len: 1235 microversion: 2.1 time: 0.100007 Apr 12 16:03:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 105/310] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:35 2023] GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => generated 1235 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:36 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0cece6-9b26-4c87-9e48-2c0437cb9190", "name": "network-vif-unplugged", "status": "completed", "tag": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0"}, {"server_uuid": "ad0cece6-9b26-4c87-9e48-2c0437cb9190", "name": "network-vif-plugged", "status": "completed", "tag": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Creating event network-vif-unplugged:b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 on user Apr 12 16:03:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] Creating event network-vif-plugged:b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 on user Apr 12 16:03:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-2e1a3304-0d22-4c5e-b166-a37dc6f2a1c4 req-1ffcd91f-49ab-4332-9fa9-1b159a241411 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031375 Apr 12 16:03:36 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 102/311] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:36 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:37 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:03:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-dc94ae03-2e87-42dc-935c-0c213f69f8c0 req-47a4fe8f-a6f2-4ed7-a1fc-1cd27964d60c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042944 Apr 12 16:03:37 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 105/312] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:38 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-1f98786e-cd04-4977-b56a-5f34fe00d78c req-e01101f1-9fbe-4b1a-bcf0-c6b092cec807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad0cece6-9b26-4c87-9e48-2c0437cb9190", "name": "network-vif-deleted", "tag": "b734d9d7-5bb7-4ca9-a637-9c335398dfc0"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1f98786e-cd04-4977-b56a-5f34fe00d78c req-e01101f1-9fbe-4b1a-bcf0-c6b092cec807 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1f98786e-cd04-4977-b56a-5f34fe00d78c req-e01101f1-9fbe-4b1a-bcf0-c6b092cec807 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1f98786e-cd04-4977-b56a-5f34fe00d78c req-e01101f1-9fbe-4b1a-bcf0-c6b092cec807 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-1f98786e-cd04-4977-b56a-5f34fe00d78c req-e01101f1-9fbe-4b1a-bcf0-c6b092cec807 service nova] Creating event network-vif-deleted:b734d9d7-5bb7-4ca9-a637-9c335398dfc0 for instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 on user Apr 12 16:03:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-1f98786e-cd04-4977-b56a-5f34fe00d78c req-e01101f1-9fbe-4b1a-bcf0-c6b092cec807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034262 Apr 12 16:03:38 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 106/313] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:39 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:39 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-plugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:03:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-dd24e521-8ebe-4d34-844d-11300d98d995 req-bab683f3-872c-49c9-b58f-50c45db5cab0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057122 Apr 12 16:03:39 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 103/314] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:39 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] Creating event network-vif-plugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:03:39 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-d758d38b-a998-4291-b452-bdcebaa2f7a4 req-8b381fa9-57b0-4695-832d-c2db76c485d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048511 Apr 12 16:03:39 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 106/315] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:41 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e", "tag": "20f49d80-ccad-450e-baed-417505f17cc2"}, {"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-plugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Creating event network-changed:20f49d80-ccad-450e-baed-417505f17cc2 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e on user Apr 12 16:03:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] Creating event network-vif-plugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:03:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-dee16c85-b5cf-4565-937c-57ef6497aa15 req-54f92d16-f973-4055-8d42-c751ef955691 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.039152 Apr 12 16:03:41 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 107/316] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:41 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:41 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] HTTP exception thrown: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Request method failure captured: Apr 12 16:03:41 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac HTTP/1.1 Apr 12 16:03:41 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:03:41 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:03:41 user devstack@n-api.service[61659]: Connection: close Apr 12 16:03:41 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:03:41 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:03:41 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:03:41 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:03:41 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVQWFg1R7C1fG1Jr5H2x3B3Vd-a-XYQdApDho9T9n6_UFGiylJPPzqO2WyH3tY8CPdmvXrp9neM_fs4O81l8AJYVHqfFHz8J1vRqPOO-xj0AedFIrbMZBerfsxTxdt0JBca-x8Df8PPE7MKsUCceKZJb4hQUhRezovCZqedBisbLsQ Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Project-Id: 8197a98d7ebc4230899aca82b073ab15 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Project-Name: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Tenant: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Tenant-Id: 8197a98d7ebc4230899aca82b073ab15 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-User: tempest-TaggedAttachmentsTest-475014275-project-member Apr 12 16:03:41 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:03:41 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:03:41 user devstack@n-api.service[61659]: X-User-Id: 324eb9033e62405ca2b322bcb6da9a04 Apr 12 16:03:41 user devstack@n-api.service[61659]: X-User-Name: tempest-TaggedAttachmentsTest-475014275-project-member Apr 12 16:03:41 user devstack@n-api.service[61659]: method: > Apr 12 16:03:41 user devstack@n-api.service[61659]: exception: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:41 user devstack@n-api.service[61659]: action_args: {'id': '55aff314-eb5e-4752-af9f-a4021e970cac'} Apr 12 16:03:41 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:41 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:03:41 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Returning 404 to user: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:41 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-82c4f456-e884-4612-84ab-ad6ae4a6d51f tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 404 len: 111 microversion: 2.49 time: 0.039523 Apr 12 16:03:41 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 104/317] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:41 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:41 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-db1bc6c5-4227-4c46-8cec-22d260899bbf tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '.version_select at 0x7fdee7a76170>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-db1bc6c5-4227-4c46-8cec-22d260899bbf tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057580771" status: 204 len: 0 microversion: 2.49 time: 0.034692 Apr 12 16:03:41 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 107/318] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 16:03:41 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2057580771 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:42 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4cce9c98-fc77-4719-ab2f-2455cf72a2ba tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d" status: 200 len: 1485 microversion: 2.1 time: 0.248852 Apr 12 16:03:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 108/319] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:42 2023] GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d => generated 1485 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e", "name": "network-vif-plugged", "status": "completed", "tag": "20f49d80-ccad-450e-baed-417505f17cc2"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] Creating event network-vif-plugged:20f49d80-ccad-450e-baed-417505f17cc2 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e on user Apr 12 16:03:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-9160fc15-c283-4ba0-bec8-c02b0447ef98 req-14b81c31-6f0d-43aa-8640-b7ad4f2f4e66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045637 Apr 12 16:03:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 105/320] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] HTTP exception thrown: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Request method failure captured: Apr 12 16:03:44 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac HTTP/1.1 Apr 12 16:03:44 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:03:44 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:03:44 user devstack@n-api.service[61657]: Connection: close Apr 12 16:03:44 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:03:44 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:03:44 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:03:44 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:03:44 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVQWFg1R7C1fG1Jr5H2x3B3Vd-a-XYQdApDho9T9n6_UFGiylJPPzqO2WyH3tY8CPdmvXrp9neM_fs4O81l8AJYVHqfFHz8J1vRqPOO-xj0AedFIrbMZBerfsxTxdt0JBca-x8Df8PPE7MKsUCceKZJb4hQUhRezovCZqedBisbLsQ Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Project-Id: 8197a98d7ebc4230899aca82b073ab15 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Project-Name: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Tenant: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Tenant-Id: 8197a98d7ebc4230899aca82b073ab15 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-User: tempest-TaggedAttachmentsTest-475014275-project-member Apr 12 16:03:44 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:03:44 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:03:44 user devstack@n-api.service[61657]: X-User-Id: 324eb9033e62405ca2b322bcb6da9a04 Apr 12 16:03:44 user devstack@n-api.service[61657]: X-User-Name: tempest-TaggedAttachmentsTest-475014275-project-member Apr 12 16:03:44 user devstack@n-api.service[61657]: method: > Apr 12 16:03:44 user devstack@n-api.service[61657]: exception: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61657]: action_args: {'id': '55aff314-eb5e-4752-af9f-a4021e970cac'} Apr 12 16:03:44 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Returning 404 to user: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e9899e10-b8e9-4b31-a6ca-88facf312374 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 404 len: 111 microversion: 2.49 time: 0.049142 Apr 12 16:03:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 108/321] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:03:44 2023] DELETE /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] [instance: 55aff314-eb5e-4752-af9f-a4021e970cac] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:44 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] HTTP exception thrown: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Request method failure captured: Apr 12 16:03:44 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac HTTP/1.1 Apr 12 16:03:44 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:03:44 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:03:44 user devstack@n-api.service[61658]: Connection: close Apr 12 16:03:44 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:03:44 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:03:44 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:03:44 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:03:44 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVQWFg1R7C1fG1Jr5H2x3B3Vd-a-XYQdApDho9T9n6_UFGiylJPPzqO2WyH3tY8CPdmvXrp9neM_fs4O81l8AJYVHqfFHz8J1vRqPOO-xj0AedFIrbMZBerfsxTxdt0JBca-x8Df8PPE7MKsUCceKZJb4hQUhRezovCZqedBisbLsQ Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.49 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Project-Id: 8197a98d7ebc4230899aca82b073ab15 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Project-Name: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8197a98d7ebc4230899aca82b073ab15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Tenant: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Tenant-Id: 8197a98d7ebc4230899aca82b073ab15 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TaggedAttachmentsTest-475014275 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-User: tempest-TaggedAttachmentsTest-475014275-project-member Apr 12 16:03:44 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:03:44 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:03:44 user devstack@n-api.service[61658]: X-User-Id: 324eb9033e62405ca2b322bcb6da9a04 Apr 12 16:03:44 user devstack@n-api.service[61658]: X-User-Name: tempest-TaggedAttachmentsTest-475014275-project-member Apr 12 16:03:44 user devstack@n-api.service[61658]: method: > Apr 12 16:03:44 user devstack@n-api.service[61658]: exception: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61658]: action_args: {'id': '55aff314-eb5e-4752-af9f-a4021e970cac'} Apr 12 16:03:44 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. Apr 12 16:03:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:03:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] Returning 404 to user: Instance 55aff314-eb5e-4752-af9f-a4021e970cac could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:03:44 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-afe38e2b-563b-4d5f-9f24-dc8bfbea11a4 tempest-TaggedAttachmentsTest-475014275 tempest-TaggedAttachmentsTest-475014275-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac" status: 404 len: 111 microversion: 2.49 time: 0.049361 Apr 12 16:03:44 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 109/322] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:03:44 2023] GET /compute/v2.1/servers/55aff314-eb5e-4752-af9f-a4021e970cac => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:03:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e", "name": "network-vif-plugged", "status": "completed", "tag": "20f49d80-ccad-450e-baed-417505f17cc2"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:45 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:45 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=60,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] Creating event network-vif-plugged:20f49d80-ccad-450e-baed-417505f17cc2 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e on user Apr 12 16:03:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-df3cd54c-7301-4972-bf2f-4bb5fd217acf req-099ddb6b-a505-4eae-bdd5-294db763144d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060065 Apr 12 16:03:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 106/323] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:51 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:51 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=10 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:51 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1b2190eb-f5c5-46b0-8f2f-ea41c4c1eb06 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Action: 'create', calling method: .version_select at 0x7fdee78bb520>, body: {"keypair": {"name": "tempest-keypair-1356498122", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAam8LYyB+LjNdQE4JBvTI3p3CIYJWs7/MCfiZUy9Xd8eIW/jYHvtZuhkG/lsvTL9zeSBHrSduF7W+pN/Bj80hUnONEMW2bSoSjFErg09RBlgz7o7NI0zfHfHDu88Z99bg=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:51 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:51 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-1b2190eb-f5c5-46b0-8f2f-ea41c4c1eb06 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Getting quotas for project 3deffbb4769b4985b038b4adcd82b018. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:03:51 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-1b2190eb-f5c5-46b0-8f2f-ea41c4c1eb06 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Getting quotas for user f76e286bd75a4cbaad7a7b735014f3d7 and project 3deffbb4769b4985b038b4adcd82b018. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:03:51 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1b2190eb-f5c5-46b0-8f2f-ea41c4c1eb06 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.269486 Apr 12 16:03:51 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 109/324] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:03:51 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:03:53 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-689097339", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "0e139ef7-ae53-4cce-9063-218ac1a19c0c"}], "security_groups": [{"name": "tempest-securitygroup--1226208291"}], "key_name": "tempest-keypair-1356498122", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:53 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:53 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:53 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] validate_networks() for [('0e139ef7-ae53-4cce-9063-218ac1a19c0c', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=6,nova_cell1:INSERT=3,nova_cell1:DELETE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Getting quotas for project 3deffbb4769b4985b038b4adcd82b018. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Getting quotas for user f76e286bd75a4cbaad7a7b735014f3d7 and project 3deffbb4769b4985b038b4adcd82b018. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:03:54 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:03:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-52df2c99-f1ec-4502-b0e6-2ccbd786cb82 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.013427 Apr 12 16:03:54 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 110/325] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:03:53 2023] POST /compute/v2.1/servers => generated 404 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:03:54 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-629aeac2-6ff3-45ed-a236-f02d5e36fc36 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:03:54 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-629aeac2-6ff3-45ed-a236-f02d5e36fc36 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:03:54 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-629aeac2-6ff3-45ed-a236-f02d5e36fc36 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:03:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-629aeac2-6ff3-45ed-a236-f02d5e36fc36 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 200 len: 1239 microversion: 2.1 time: 0.123110 Apr 12 16:03:54 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 107/326] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:03:54 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 1239 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:03:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:03:58 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:03:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:03:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:03:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:03:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] Creating event network-changed:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:03:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3a12f1d4-b9ba-4b42-a7c4-1abcc98c4972 req-d9ab6855-10c9-4d13-9bec-7d1fb5600499 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062123 Apr 12 16:03:58 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:03:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:01 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:04:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-237d7832-4ce2-4030-9e55-4bc162794827 req-b91e02d4-2cb5-405a-8a58-0c9e1d7c09b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057593 Apr 12 16:04:01 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 111/328] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:01 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61659) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 16:04:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a6b165c5-cf5d-4c81-9fbf-a1ea238da5ef tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3/action" status: 202 len: 0 microversion: 2.1 time: 0.122096 Apr 12 16:04:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 108/329] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:04:01 2023] POST /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:01 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:02 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3a4e3e5b-09b3-4448-864e-279b747a3476 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1505 microversion: 2.1 time: 0.444941 Apr 12 16:04:02 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 111/330] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:01 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:04:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-bae44568-4dd9-49aa-987b-f90af1d6c276 req-53c3c91f-c845-4ba8-9d46-f889faefc2bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031492 Apr 12 16:04:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 112/331] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:06 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid afebffae-dbf6-4876-8c9f-0364f0fde49c {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:04:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-83d91fc8-dbfb-463d-b04a-abe0cf5a9505 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c/action" status: 200 len: 32 microversion: 2.1 time: 0.151242 Apr 12 16:04:06 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 109/332] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:04:06 2023] POST /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c/action => generated 32 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:06 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-011e2162-c56e-4b63-9d43-8f37115d15e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 200 len: 1510 microversion: 2.1 time: 0.407969 Apr 12 16:04:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:06 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 1510 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:07 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-unplugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:07 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:07 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] Creating event network-vif-unplugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:04:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-5e152d8e-e482-4cf1-8968-272feba7a294 req-9ab4b3a2-1a7a-4f01-8f68-55158ea8e2ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044225 Apr 12 16:04:07 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 113/334] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] [instance: e85aa869-0d2a-40ff-9697-f979a6b110cb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] HTTP exception thrown: Instance e85aa869-0d2a-40ff-9697-f979a6b110cb could not be found. Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Request method failure captured: Apr 12 16:04:08 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb HTTP/1.1 Apr 12 16:04:08 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:04:08 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:04:08 user devstack@n-api.service[61657]: Connection: close Apr 12 16:04:08 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:04:08 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:04:08 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:04:08 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:04:08 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVZ8Yrzn9U7NKKVDs_7GRj_9ldgFgujAYbzkqIfwypceDNCEG-qGsS4S_8LtaIhwZElMJo_7EvmIemRkLJX5xMCRE6C8oBoNOVDpPXKPBI0JBLqVyCQ2zQWhF_Hy3KSFLlzxSupAG3K9jUaLNGAfArOMzBcmKRYl7X6143YYq816Rw Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Project-Id: 5a8e21d4dae04fd08951f8306cff0624 Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestVolumeSwap-432048888 Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5a8e21d4dae04fd08951f8306cff0624"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a8e21d4dae04fd08951f8306cff0624"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5a8e21d4dae04fd08951f8306cff0624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Tenant: tempest-TestVolumeSwap-432048888 Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Tenant-Id: 5a8e21d4dae04fd08951f8306cff0624 Apr 12 16:04:08 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestVolumeSwap-432048888 Apr 12 16:04:08 user devstack@n-api.service[61657]: X-User: tempest-TestVolumeSwap-432048888-project-member Apr 12 16:04:08 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:04:08 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:04:08 user devstack@n-api.service[61657]: X-User-Id: d2e5f900d0b144f9942de733017fb396 Apr 12 16:04:08 user devstack@n-api.service[61657]: X-User-Name: tempest-TestVolumeSwap-432048888-project-member Apr 12 16:04:08 user devstack@n-api.service[61657]: method: > Apr 12 16:04:08 user devstack@n-api.service[61657]: exception: Instance e85aa869-0d2a-40ff-9697-f979a6b110cb could not be found. Apr 12 16:04:08 user devstack@n-api.service[61657]: action_args: {'id': 'e85aa869-0d2a-40ff-9697-f979a6b110cb'} Apr 12 16:04:08 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85aa869-0d2a-40ff-9697-f979a6b110cb could not be found. Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85aa869-0d2a-40ff-9697-f979a6b110cb could not be found. Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85aa869-0d2a-40ff-9697-f979a6b110cb could not be found. Apr 12 16:04:08 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:04:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Returning 404 to user: Instance e85aa869-0d2a-40ff-9697-f979a6b110cb could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:04:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f061a14f-0a3e-484b-bd44-1695306f33fa tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb" status: 404 len: 111 microversion: 2.1 time: 0.045047 Apr 12 16:04:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 113/335] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:08 2023] GET /compute/v2.1/servers/e85aa869-0d2a-40ff-9697-f979a6b110cb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:04:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1cbe995c-1b3f-4109-80fb-caef6f71d3f7 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] Calling method '.version_select at 0x7fdee7cded40>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1cbe995c-1b3f-4109-80fb-caef6f71d3f7 tempest-TestVolumeSwap-432048888 tempest-TestVolumeSwap-432048888-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069057277" status: 202 len: 0 microversion: 2.1 time: 0.038572 Apr 12 16:04:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 114/336] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 16:04:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1069057277 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:08 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a689b83f-d256-47c3-b8c9-a6c0a4122327 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 200 len: 1782 microversion: 2.20 time: 0.412936 Apr 12 16:04:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 110/337] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:04:08 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 1782 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:04:09 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] Creating event network-changed:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:04:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-02aa8b58-e862-433a-8071-64e0b78bc77f req-57bd6bf1-c55e-4645-8d3b-a30bf23ca020 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076639 Apr 12 16:04:09 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 114/338] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:04:09 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:04:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d1713876-efc9-4ccb-b84d-285dc12e2b28 req-12be5986-ca02-40c6-b369-8498fe62a9a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034028 Apr 12 16:04:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 115/339] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}, {"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:11 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:04:11 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:04:11 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-d83cc506-b231-40a0-8489-e5272e7549e0 req-b421c45c-cbb9-4995-a900-57f57aded937 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054373 Apr 12 16:04:11 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 111/340] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "a4390902-ded6-46bd-95d0-5aa40c33bd1e"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:12 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'flavor' on Instance uuid f52ee906-c8fd-4cd5-842e-de98a5099c4f {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:04:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5cd07e0c-c7dd-41f1-80aa-dea9dfae557f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f/action" status: 200 len: 29 microversion: 2.87 time: 0.627388 Apr 12 16:04:13 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 115/341] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:04:12 2023] POST /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f/action => generated 29 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] Creating event network-vif-plugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:04:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-f3d271b1-5fdf-48f4-bf4e-b72044774264 req-1399bbed-69b1-4027-8610-fcf3324f007c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056449 Apr 12 16:04:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 112/342] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:13 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-d55c8bf7-18c1-4d00-99a8-6a6ccfb7f6ba tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 200 len: 1775 microversion: 2.87 time: 0.791826 Apr 12 16:04:13 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 116/343] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:04:13 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 1775 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:04:14 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-63d560bd-3c5e-4a49-9537-01657a89c5b4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1721 microversion: 2.1 time: 0.464257 Apr 12 16:04:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 116/344] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:13 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1721 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:15 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}, {"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}, {"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Creating event network-vif-plugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:04:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Creating event network-vif-unplugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:04:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:04:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-33928b2d-5ab9-436e-9a48-d43f0cf5844e req-c391b7ed-b02e-478a-ae8f-9702c5bb8e01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.100083 Apr 12 16:04:15 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 113/345] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:15 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:04:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-8004588b-5fe9-43b6-827d-b6bd32174232 req-1c20da78-6fc1-476e-a088-be2411cf5187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038291 Apr 12 16:04:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 117/346] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:22 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:04:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e07a0a80-93a1-4cb6-ad01-5e66bbcbebf0 req-d6e306d2-c031-4cb7-8e50-a7aa7440949e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051418 Apr 12 16:04:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 117/347] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:04:24 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 HTTP/1.1 Apr 12 16:04:24 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:04:24 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:04:24 user devstack@n-api.service[61659]: Connection: close Apr 12 16:04:24 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:04:24 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:04:24 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:04:24 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:04:24 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:04:24 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:04:24 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:04:24 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:04:24 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:04:24 user devstack@n-api.service[61659]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:04:24 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:04:24 user devstack@n-api.service[61659]: method: > Apr 12 16:04:24 user devstack@n-api.service[61659]: exception: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:04:24 user devstack@n-api.service[61659]: action_args: {'id': 'ad0cece6-9b26-4c87-9e48-2c0437cb9190'} Apr 12 16:04:24 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:04:24 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:04:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:04:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5d8c0a2e-5bc8-40c7-9242-4a781f44ab6b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190" status: 404 len: 111 microversion: 2.1 time: 0.036857 Apr 12 16:04:24 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 114/348] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:24 2023] GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:04:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-9ee59fdd-ce8e-4417-897e-e69aa72a66b4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '.version_select at 0x7fdee786b250>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-9ee59fdd-ce8e-4417-897e-e69aa72a66b4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-42069222" status: 202 len: 0 microversion: 2.1 time: 0.034059 Apr 12 16:04:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 118/349] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 16:04:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-42069222 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:25 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ecfb9de2-636f-4d72-ba8b-2ac3eaf4c8f6 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" status: 200 len: 1539 microversion: 2.1 time: 0.405922 Apr 12 16:04:25 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 118/350] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:25 2023] GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => generated 1539 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:27 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'services' on Instance uuid 920c6512-180d-46e1-b0cf-240d34c3fc97 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:04:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-4ab37256-6ea9-4f20-a010-a92b90fe90d8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments/8d4e6a19-342a-43eb-b9dc-9570b802fbe6" status: 202 len: 0 microversion: 2.1 time: 0.368516 Apr 12 16:04:27 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 115/351] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:04:26 2023] DELETE /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments/8d4e6a19-342a-43eb-b9dc-9570b802fbe6 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:27 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=19 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2f9cedee-5c0c-414f-b3ff-3a1188357bea tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098078 Apr 12 16:04:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 119/352] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:04:27 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-454092624", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "6f3d0490-15bc-474a-a508-bc36fefa8464"}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:34 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] validate_networks() for [('6f3d0490-15bc-474a-a508-bc36fefa8464', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Getting quotas for project 9decbec41a40484b9dd236a12964a08a. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Getting quotas for user 584e4a8ef8c943a7a4ab711cf3adc366 and project 9decbec41a40484b9dd236a12964a08a. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:04:35 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:04:35 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c46e5ad6-ae8d-48e4-9355-b534458f4982 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.680212 Apr 12 16:04:35 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 119/353] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:04:34 2023] POST /compute/v2.1/servers => generated 378 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:04:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f4c89225-beb2-42ee-a6e5-32176bd8ca0b tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f4c89225-beb2-42ee-a6e5-32176bd8ca0b tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:35 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-f4c89225-beb2-42ee-a6e5-32176bd8ca0b tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584e4a8ef8c943a7a4ab711cf3adc366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9decbec41a40484b9dd236a12964a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:35 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f4c89225-beb2-42ee-a6e5-32176bd8ca0b tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91" status: 200 len: 1208 microversion: 2.1 time: 0.067676 Apr 12 16:04:35 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 116/354] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:35 2023] GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 => generated 1208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:38 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] Creating event network-changed:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:04:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-3fb1bf7a-522c-4902-b366-5cf5d23cf9fd req-c2fa09bb-b691-43ca-9fb2-00cc426b2ea1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263784 Apr 12 16:04:39 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 120/355] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:41 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-plugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] Creating event network-vif-plugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:04:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a1414f53-e501-4a02-bd6a-673ca70d5d1d req-6fd5354c-9b81-436b-bc0c-025371cf4ae7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289318 Apr 12 16:04:41 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 120/356] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1370025872", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] validate_networks() for None {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Getting quotas for project 1b99813570054c54ada10220d1fe69ae. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Getting quotas for user 4e119bed0d354349b36bc6cf426e4929 and project 1b99813570054c54ada10220d1fe69ae. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:04:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-21d46542-2116-466e-ac17-9d59ade099db tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.439374 Apr 12 16:04:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 117/357] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:04:42 2023] POST /compute/v2.1/servers => generated 378 bytes in 441 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1dff31f3-159d-46ea-a2c6-d864581286cd tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1dff31f3-159d-46ea-a2c6-d864581286cd tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-1dff31f3-159d-46ea-a2c6-d864581286cd tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e119bed0d354349b36bc6cf426e4929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99813570054c54ada10220d1fe69ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1dff31f3-159d-46ea-a2c6-d864581286cd tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb" status: 200 len: 1209 microversion: 2.1 time: 0.087530 Apr 12 16:04:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 121/358] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:43 2023] GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:43 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-plugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:43 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] Creating event network-vif-plugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:04:43 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-c6db31d8-57a4-4d01-bd87-b6a5f8e6eae6 req-e09ac1a2-1419-4fe4-add4-b9387d52b3d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036272 Apr 12 16:04:43 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 121/359] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:04:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-21bd938f-857e-4f07-84f7-7375a9d8f539 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d" status: 204 len: 0 microversion: 2.1 time: 0.115282 Apr 12 16:04:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 118/360] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:04:43 2023] DELETE /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:44 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5d01dd905404e4aa08a31f25fa53338', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bde51ff8bde4dcdb14fcda0fc92d564', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:44 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5ad2a423-678e-41e1-bd67-b3fdc95e5c43 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d" status: 200 len: 1491 microversion: 2.1 time: 0.245110 Apr 12 16:04:44 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 122/361] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:43 2023] GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d => generated 1491 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285eef6-6613-4802-a988-3fae065fa92d", "name": "network-vif-unplugged", "status": "completed", "tag": "56615a48-49c1-42dd-8326-5806056ea7cf"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] Creating event network-vif-unplugged:56615a48-49c1-42dd-8326-5806056ea7cf for instance 2285eef6-6613-4802-a988-3fae065fa92d on user Apr 12 16:04:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e5ce900e-b349-4d80-b450-592dfe46f165 req-d25427bf-b926-41cf-8366-9b093b80bb80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036197 Apr 12 16:04:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 122/362] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:45 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-66e11220-e5da-4dd6-81e3-be265a276ee8 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 200 len: 1554 microversion: 2.1 time: 0.154888 Apr 12 16:04:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 119/363] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:44 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:45 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-aaed3ba1-73d2-43c1-8112-3f0cf4ad3e89 req-14a1414a-e5ea-4bca-b434-095ba22068ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285eef6-6613-4802-a988-3fae065fa92d", "name": "network-vif-deleted", "tag": "56615a48-49c1-42dd-8326-5806056ea7cf"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-aaed3ba1-73d2-43c1-8112-3f0cf4ad3e89 req-14a1414a-e5ea-4bca-b434-095ba22068ac service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-aaed3ba1-73d2-43c1-8112-3f0cf4ad3e89 req-14a1414a-e5ea-4bca-b434-095ba22068ac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-aaed3ba1-73d2-43c1-8112-3f0cf4ad3e89 req-14a1414a-e5ea-4bca-b434-095ba22068ac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-aaed3ba1-73d2-43c1-8112-3f0cf4ad3e89 req-14a1414a-e5ea-4bca-b434-095ba22068ac service nova] Creating event network-vif-deleted:56615a48-49c1-42dd-8326-5806056ea7cf for instance 2285eef6-6613-4802-a988-3fae065fa92d on user Apr 12 16:04:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-aaed3ba1-73d2-43c1-8112-3f0cf4ad3e89 req-14a1414a-e5ea-4bca-b434-095ba22068ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033745 Apr 12 16:04:45 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 123/364] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:46 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:46 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:46 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2285eef6-6613-4802-a988-3fae065fa92d", "name": "network-vif-plugged", "status": "completed", "tag": "56615a48-49c1-42dd-8326-5806056ea7cf"}, {"name": "network-changed", "server_uuid": "cb8fd1e4-401b-4f73-a789-b7183f9003fb", "tag": "7a9fa84a-39d3-4580-b205-6a75686ba943"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:46 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Creating event network-vif-plugged:56615a48-49c1-42dd-8326-5806056ea7cf for instance 2285eef6-6613-4802-a988-3fae065fa92d on user Apr 12 16:04:46 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] Creating event network-changed:7a9fa84a-39d3-4580-b205-6a75686ba943 for instance cb8fd1e4-401b-4f73-a789-b7183f9003fb on user Apr 12 16:04:46 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-c77b747a-ee85-42a9-8912-a90bd7252404 req-fbc8719d-c83b-4df6-addd-d4bd11b1a76e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.089646 Apr 12 16:04:46 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 123/365] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:46 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:48 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fd1e4-401b-4f73-a789-b7183f9003fb", "name": "network-vif-plugged", "status": "completed", "tag": "7a9fa84a-39d3-4580-b205-6a75686ba943"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] Creating event network-vif-plugged:7a9fa84a-39d3-4580-b205-6a75686ba943 for instance cb8fd1e4-401b-4f73-a789-b7183f9003fb on user Apr 12 16:04:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-90c8362f-b0a3-4656-b9f5-c185a6793fc6 req-e6f229ee-1b2f-47cb-8d95-787d66d7664e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029675 Apr 12 16:04:48 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 120/366] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fd1e4-401b-4f73-a789-b7183f9003fb", "name": "network-vif-plugged", "status": "completed", "tag": "7a9fa84a-39d3-4580-b205-6a75686ba943"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:04:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] Creating event network-vif-plugged:7a9fa84a-39d3-4580-b205-6a75686ba943 for instance cb8fd1e4-401b-4f73-a789-b7183f9003fb on user Apr 12 16:04:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-8ff1136a-6740-4a85-ac18-80481e76781e req-bf77d90f-d9de-48f6-9a0e-4774a0efb641 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035217 Apr 12 16:04:50 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:04:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:52 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e28f3a2a-dfb5-4cf5-87d8-27a5c757bc37 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1550 microversion: 2.1 time: 0.191971 Apr 12 16:04:52 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 124/368] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:52 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1550 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:04:56 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:56 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=8 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:04:57 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:04:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b6f667e8-7d3a-4a0a-b58d-64f94eddf342 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 200 len: 1490 microversion: 2.1 time: 0.494737 Apr 12 16:04:57 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 121/369] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:04:56 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 1490 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:03 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:03 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=12 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:03 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=17 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:04 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2626754b-9e23-46bd-b8d0-0ec5ca7b8238 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 200 len: 1755 microversion: 2.87 time: 0.276739 Apr 12 16:05:04 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 125/370] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:05:03 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 1755 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=15 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-dff73dcd-2bb5-46f3-b012-aed14930f08a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments/cfd27585-75c7-4a04-a93a-79e4236a36f7" status: 200 len: 194 microversion: 2.20 time: 0.156775 Apr 12 16:05:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 125/371] 10.0.0.210 () {64 vars in 1531 bytes} [Wed Apr 12 16:05:08 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments/cfd27585-75c7-4a04-a93a-79e4236a36f7 => generated 194 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:09 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'services' on Instance uuid fc19fd8d-3285-4ceb-8714-a0ba139f3045 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:05:09 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-558f79b8-29fc-4842-9e9b-3228d5eff766 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments/cfd27585-75c7-4a04-a93a-79e4236a36f7" status: 202 len: 0 microversion: 2.20 time: 0.174676 Apr 12 16:05:09 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 122/372] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 16:05:08 2023] DELETE /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments/cfd27585-75c7-4a04-a93a-79e4236a36f7 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4a625b39-e111-43e1-96ce-423f70aeed6d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050411 Apr 12 16:05:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 126/373] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 16:05:09 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:14 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5fab01b6-b348-4741-a7b0-ea6a8d69f344 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1721 microversion: 2.1 time: 0.258515 Apr 12 16:05:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 126/374] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:14 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:14 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b6a92fc5-0ddb-4717-bd9c-5d0e644931e1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1721 microversion: 2.1 time: 0.166930 Apr 12 16:05:14 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 123/375] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:14 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-103a1355-419e-4933-aee1-e7f0c5fa5e42 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054363 Apr 12 16:05:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 127/376] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:05:17 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:17 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:05:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5c710970-b795-4631-a974-0d7c59ee599a tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97" status: 204 len: 0 microversion: 2.1 time: 0.129833 Apr 12 16:05:17 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 127/377] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:05:17 2023] DELETE /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:17 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:17 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-9ec24b99-f8f1-4bd6-97f4-41eb240ae485 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97" status: 200 len: 1667 microversion: 2.1 time: 0.303730 Apr 12 16:05:17 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 124/378] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:17 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 => generated 1667 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920c6512-180d-46e1-b0cf-240d34c3fc97", "name": "network-vif-unplugged", "status": "completed", "tag": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] Creating event network-vif-unplugged:f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 on user Apr 12 16:05:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-fe9f5bc8-7ce0-4e14-8a94-45c4735759b5 req-e13bd06e-caa9-4dfb-a95d-be42c5eb4553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033006 Apr 12 16:05:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 128/379] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "920c6512-180d-46e1-b0cf-240d34c3fc97", "name": "network-vif-plugged", "status": "completed", "tag": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e"}, {"server_uuid": "920c6512-180d-46e1-b0cf-240d34c3fc97", "name": "network-vif-deleted", "tag": "f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Creating event network-vif-plugged:f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 on user Apr 12 16:05:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] Creating event network-vif-deleted:f0f2f7c4-d9e5-4b71-88d0-1f66e8d7a81e for instance 920c6512-180d-46e1-b0cf-240d34c3fc97 on user Apr 12 16:05:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3bd8ea2d-ad5d-4432-86b9-03faaa463b53 req-5b33b55b-9448-407e-88bc-d73790fe11ba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056062 Apr 12 16:05:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 128/380] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:25 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584e4a8ef8c943a7a4ab711cf3adc366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9decbec41a40484b9dd236a12964a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:25 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5da16d22-47a1-4457-8267-28b2fe5053ec tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91" status: 200 len: 1489 microversion: 2.1 time: 0.146147 Apr 12 16:05:25 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 125/381] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:25 2023] GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 => generated 1489 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:25 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b29b7110-cecf-4a8c-bba4-54c8679c4427 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.099840 Apr 12 16:05:25 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 129/382] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:05:25 2023] GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:27 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e", "tag": "20f49d80-ccad-450e-baed-417505f17cc2"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] Creating event network-changed:20f49d80-ccad-450e-baed-417505f17cc2 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e on user Apr 12 16:05:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-6c1e2bd4-bf74-460d-96a3-29f076c4f305 req-26a2da69-543c-443c-800d-f91162464abd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109870 Apr 12 16:05:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 129/383] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a7e94ba-eba5-4550-99a9-78eda9d700df"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-eb35493b-6340-4d99-bc64-cededf6f6d44 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384218 Apr 12 16:05:28 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 126/384] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:05:28 2023] POST /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:33 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e119bed0d354349b36bc6cf426e4929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99813570054c54ada10220d1fe69ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-cdca80db-bd10-416c-abf5-f735efccddf8 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb" status: 200 len: 1454 microversion: 2.1 time: 0.175200 Apr 12 16:05:33 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 130/385] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:33 2023] GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] [instance: 2285eef6-6613-4802-a988-3fae065fa92d] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] HTTP exception thrown: Instance 2285eef6-6613-4802-a988-3fae065fa92d could not be found. Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Request method failure captured: Apr 12 16:05:34 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d HTTP/1.1 Apr 12 16:05:34 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:05:34 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:05:34 user devstack@n-api.service[61657]: Connection: close Apr 12 16:05:34 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:05:34 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:05:34 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:05:34 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:05:34 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtWHCS9dVMf_WqXN7cu_QEvEfMYXmNL53uGfo4nJBd4KsbmggE1ZLiofLuydp6wKgZqqx0KWFcvHpgcMJROPVEL7eyGsLpyakInHr0nFblukHmHlOsrPH3QuebTSrJo_4HOT4yT3K8UtB6147FRDlXd_8vbEBKVzuFPBla_VpkZOHl0 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Project-Id: 1bde51ff8bde4dcdb14fcda0fc92d564 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Project-Name: tempest-VolumesActionsTest-104284977 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1bde51ff8bde4dcdb14fcda0fc92d564"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1bde51ff8bde4dcdb14fcda0fc92d564"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1bde51ff8bde4dcdb14fcda0fc92d564"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Tenant: tempest-VolumesActionsTest-104284977 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Tenant-Id: 1bde51ff8bde4dcdb14fcda0fc92d564 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-VolumesActionsTest-104284977 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-User: tempest-VolumesActionsTest-104284977-project-member Apr 12 16:05:34 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:05:34 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:05:34 user devstack@n-api.service[61657]: X-User-Id: c5d01dd905404e4aa08a31f25fa53338 Apr 12 16:05:34 user devstack@n-api.service[61657]: X-User-Name: tempest-VolumesActionsTest-104284977-project-member Apr 12 16:05:34 user devstack@n-api.service[61657]: method: > Apr 12 16:05:34 user devstack@n-api.service[61657]: exception: Instance 2285eef6-6613-4802-a988-3fae065fa92d could not be found. Apr 12 16:05:34 user devstack@n-api.service[61657]: action_args: {'id': '2285eef6-6613-4802-a988-3fae065fa92d'} Apr 12 16:05:34 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2285eef6-6613-4802-a988-3fae065fa92d could not be found. Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2285eef6-6613-4802-a988-3fae065fa92d could not be found. Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2285eef6-6613-4802-a988-3fae065fa92d could not be found. Apr 12 16:05:34 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] Returning 404 to user: Instance 2285eef6-6613-4802-a988-3fae065fa92d could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:05:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-8f99d9a2-881e-4523-9dee-a20360a9cd81 tempest-VolumesActionsTest-104284977 tempest-VolumesActionsTest-104284977-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d" status: 404 len: 111 microversion: 2.1 time: 0.143271 Apr 12 16:05:34 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 130/386] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:34 2023] GET /compute/v2.1/servers/2285eef6-6613-4802-a988-3fae065fa92d => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "8aca4add-eb05-4121-921e-b5e26c62449f"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:35 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] HTTP exception thrown: Volume 8aca4add-eb05-4121-921e-b5e26c62449f could not be found. Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Request method failure captured: Apr 12 16:05:35 user devstack@n-api.service[61659]: request: PUT /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments/8a7e94ba-eba5-4550-99a9-78eda9d700df HTTP/1.1 Apr 12 16:05:35 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:05:35 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:05:35 user devstack@n-api.service[61659]: Connection: close Apr 12 16:05:35 user devstack@n-api.service[61659]: Content-Length: 74 Apr 12 16:05:35 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:05:35 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:05:35 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:05:35 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtZTQTqxRy8JH2ztYRMFwtHlK4_DkQJIcL-yhNYeHG-WQ6xZvuBAGSDL9kmbAndCyhy5dHD4IXBNoPYoUxkIYnwl5fZpBMEBvoercid_4l9oOC2cM2boCag1Pw9732tGM2Wh6iNiwZxHliF_y7ssGyI7faVJw7nqyfL9wcRohFRNkyw Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Project-Id: 4e22ab21a50d45dba51ee1bd30028b9b Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesAdminNegativeTest-437669774 Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Role: admin,member,reader Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Roles: admin,member,reader Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e22ab21a50d45dba51ee1bd30028b9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e22ab21a50d45dba51ee1bd30028b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e22ab21a50d45dba51ee1bd30028b9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesAdminNegativeTest-437669774 Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Tenant-Id: 4e22ab21a50d45dba51ee1bd30028b9b Apr 12 16:05:35 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-437669774 Apr 12 16:05:35 user devstack@n-api.service[61659]: X-User: tempest-VolumesAdminNegativeTest-437669774-project-admin Apr 12 16:05:35 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:05:35 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:05:35 user devstack@n-api.service[61659]: X-User-Id: 8d8e5338ebea4cb988170da84e5815e9 Apr 12 16:05:35 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesAdminNegativeTest-437669774-project-admin Apr 12 16:05:35 user devstack@n-api.service[61659]: Apr 12 16:05:35 user devstack@n-api.service[61659]: {"volumeAttachment": {"volumeId": "8aca4add-eb05-4121-921e-b5e26c62449f"}} Apr 12 16:05:35 user devstack@n-api.service[61659]: method: > Apr 12 16:05:35 user devstack@n-api.service[61659]: exception: Volume 8aca4add-eb05-4121-921e-b5e26c62449f could not be found. Apr 12 16:05:35 user devstack@n-api.service[61659]: action_args: {'server_id': 'ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e', 'id': '8a7e94ba-eba5-4550-99a9-78eda9d700df', 'body': {'volumeAttachment': {'volumeId': '8aca4add-eb05-4121-921e-b5e26c62449f'}}} Apr 12 16:05:35 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8aca4add-eb05-4121-921e-b5e26c62449f could not be found. (HTTP 404) (Request-ID: req-e2df2d91-6041-493a-af27-7db2f75ad53d) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8aca4add-eb05-4121-921e-b5e26c62449f could not be found. Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 8aca4add-eb05-4121-921e-b5e26c62449f could not be found. Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8aca4add-eb05-4121-921e-b5e26c62449f could not be found. Apr 12 16:05:35 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:05:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Returning 400 to user: Volume 8aca4add-eb05-4121-921e-b5e26c62449f could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:05:35 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-e6233c7c-63e4-425c-bf06-fecebe2d4847 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments/8a7e94ba-eba5-4550-99a9-78eda9d700df" status: 400 len: 107 microversion: 2.1 time: 0.330439 Apr 12 16:05:35 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 127/387] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 16:05:35 2023] PUT /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments/8a7e94ba-eba5-4550-99a9-78eda9d700df => generated 107 bytes in 332 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=15 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=31 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:35 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lazy-loading 'services' on Instance uuid ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:05:36 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-ad625a46-0c98-4ace-9894-a1a9efa8a8bf tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments/8a7e94ba-eba5-4550-99a9-78eda9d700df" status: 202 len: 0 microversion: 2.1 time: 0.160958 Apr 12 16:05:36 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 131/388] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:05:35 2023] DELETE /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments/8a7e94ba-eba5-4550-99a9-78eda9d700df => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-726d498a-6a02-4b22-aecb-689f78ad815c tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048033 Apr 12 16:05:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 131/389] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:05:36 2023] GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=13 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:45 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-fe962518-a4e1-47c9-ad4e-496fcebf5a37 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.111718 Apr 12 16:05:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 128/390] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:05:45 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-interface => generated 283 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=8,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-826382548"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:05:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] Creating event network-changed:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:05:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-88b599d9-bbd3-4b25-aab7-346ef985f7da req-6001b8d9-1f2b-4a7a-99fc-234413486dce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108853 Apr 12 16:05:46 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 132/391] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:47 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f05508b2-2ea6-4505-b67b-590b3be08803 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/action" status: 202 len: 0 microversion: 2.1 time: 0.934008 Apr 12 16:05:47 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 132/392] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:05:46 2023] POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/action => generated 0 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 16:05:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-abec6aed-c2f3-4b6d-9250-3fd0eae60386 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '.version_select at 0x7fdee772b490>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-abec6aed-c2f3-4b6d-9250-3fd0eae60386 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4" status: 200 len: 1608 microversion: 2.1 time: 0.089193 Apr 12 16:05:47 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 129/393] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 16:05:47 2023] GET /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4 => generated 1608 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:54 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:54 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:05:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] Creating event network-changed:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:05:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-9713e790-0dfa-4a5c-8a7a-5b4a86038ef5 req-9ca67d22-145b-41a4-83d7-af64c7475cc4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092160 Apr 12 16:05:54 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 133/394] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:54 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d0c55c5b-f33c-495a-aac7-69f25777b84d tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 204 len: 0 microversion: 2.1 time: 0.572479 Apr 12 16:05:54 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 133/395] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:05:54 2023] DELETE /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:55 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6acbd977c4b4494db95f879777184489', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a46b4e80a65541d6bab94b5edfc26e5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b2709210-e454-4795-a635-3e90285674e6 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 200 len: 1556 microversion: 2.1 time: 0.321178 Apr 12 16:05:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 130/396] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:54 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 1556 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-unplugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] Creating event network-vif-unplugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:05:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-6e0249ca-81bd-4faf-865a-45e28afb4c86 req-bc307694-ed71-49a2-abb1-7cb7e6f385e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095997 Apr 12 16:05:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 134/397] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bf28678-0ae1-41d3-a4aa-e8e973952dde"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:57 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] HTTP exception thrown: Cannot 'attach_volume' instance afebffae-dbf6-4876-8c9f-0364f0fde49c while it is in vm_state rescued Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Request method failure captured: Apr 12 16:05:57 user devstack@n-api.service[61657]: request: POST /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c/os-volume_attachments HTTP/1.1 Apr 12 16:05:57 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:05:57 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:05:57 user devstack@n-api.service[61657]: Connection: close Apr 12 16:05:57 user devstack@n-api.service[61657]: Content-Length: 74 Apr 12 16:05:57 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:05:57 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:05:57 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:05:57 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVUIREaEpSCxaDHhRTy1-3vG98zUQQrkdSdA21f2O72s3N3rIDmLgBOdKtY1raaQOA2q8xobAID4T92RRWByg3TQMewePmiVUfKjOk4N3mk2Chaqhzu21Gl8iq5G39Tfr8LyTLfxMsGVguI0Q0Es6MN889SFcfwJK58-JrBG9wNTTI Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Project-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Tenant-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:05:57 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:05:57 user devstack@n-api.service[61657]: X-User: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:05:57 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:05:57 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:05:57 user devstack@n-api.service[61657]: X-User-Id: 880266e3fa4d4dd889648c10208a1f8e Apr 12 16:05:57 user devstack@n-api.service[61657]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:05:57 user devstack@n-api.service[61657]: Apr 12 16:05:57 user devstack@n-api.service[61657]: {"volumeAttachment": {"volumeId": "0bf28678-0ae1-41d3-a4aa-e8e973952dde"}} Apr 12 16:05:57 user devstack@n-api.service[61657]: method: > Apr 12 16:05:57 user devstack@n-api.service[61657]: exception: Cannot 'attach_volume' instance afebffae-dbf6-4876-8c9f-0364f0fde49c while it is in vm_state rescued Apr 12 16:05:57 user devstack@n-api.service[61657]: action_args: {'server_id': 'afebffae-dbf6-4876-8c9f-0364f0fde49c', 'body': {'volumeAttachment': {'volumeId': '0bf28678-0ae1-41d3-a4aa-e8e973952dde'}}} Apr 12 16:05:57 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance afebffae-dbf6-4876-8c9f-0364f0fde49c while it is in vm_state rescued Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance afebffae-dbf6-4876-8c9f-0364f0fde49c while it is in vm_state rescued Apr 12 16:05:57 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Returning 409 to user: Cannot 'attach_volume' instance afebffae-dbf6-4876-8c9f-0364f0fde49c while it is in vm_state rescued {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:05:57 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-cd20f3eb-aa48-4f9e-96bf-8b1c1406b511 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064333 Apr 12 16:05:57 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 134/398] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:05:57 2023] POST /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5b6d5177-c9a9-4f68-8e43-b497ac0f92ed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c/action" status: 202 len: 0 microversion: 2.1 time: 0.076498 Apr 12 16:05:57 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 131/399] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:05:57 2023] POST /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-plugged", "status": "completed", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}, {"server_uuid": "85b91251-9735-4812-9f11-003a7951a6f3", "name": "network-vif-deleted", "tag": "567c632f-4b91-46d8-ade5-c694ee9023c1"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:57 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:57 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:57 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Creating event network-vif-plugged:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:05:57 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] Creating event network-vif-deleted:567c632f-4b91-46d8-ade5-c694ee9023c1 for instance 85b91251-9735-4812-9f11-003a7951a6f3 on user Apr 12 16:05:57 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-5c5e4a90-71d8-4b9c-baff-5ca5597aa4b2 req-9c70d29f-626d-4c7c-84dd-0c35abf68819 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040099 Apr 12 16:05:57 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:57 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:57 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-d26e1c86-5345-4b91-b28a-c4d584d4a4f0 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 200 len: 1498 microversion: 2.1 time: 0.191811 Apr 12 16:05:57 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 135/401] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:05:57 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 1498 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-unplugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] Creating event network-vif-unplugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:05:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-98a0b82f-9163-4995-b84b-08689b179bcc req-3f75cff5-bdfb-46cb-aec7-dfb8c034bd4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040242 Apr 12 16:05:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 132/402] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1595a21b-7740-4db6-8045-fa0c27864258 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.078333 Apr 12 16:05:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 136/403] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 16:05:59 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:05:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-9e9e616c-c437-4fb2-8a30-cbd3fe87f133 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 204 len: 0 microversion: 2.20 time: 0.126271 Apr 12 16:05:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 136/404] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:05:59 2023] DELETE /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:59 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:05:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-318b1104-1ce9-4743-81f6-d6a768a261dc tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 200 len: 1710 microversion: 2.20 time: 0.216697 Apr 12 16:05:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 133/405] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:05:59 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 1710 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-unplugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:05:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:05:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] Creating event network-vif-unplugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:05:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-f782e782-5c29-4ae9-b0b9-12605d7a6051 req-ee8f177e-6d0c-44c0-aa3c-b80fa9a7e1ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038401 Apr 12 16:05:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 137/406] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:05:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}, {"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:06:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:06:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-5d433752-e007-4191-9572-3b4a07a862c8 req-dd92562f-22d7-4294-98c9-eba2cd3894f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031138 Apr 12 16:06:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 137/407] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-plugged", "status": "completed", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] Creating event network-vif-plugged:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:06:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-75c2d99b-c661-4d7c-bc33-1e9a171b4ce7 req-3cd70f8c-0d9e-42c1-9b82-24eb7e4ea34c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032650 Apr 12 16:06:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 134/408] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:02 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-bbd6296b-f3a0-4e8b-ae23-55da4edae5a2 req-b70a194b-0b7f-49b0-a1d5-daf191f2920d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc19fd8d-3285-4ceb-8714-a0ba139f3045", "name": "network-vif-deleted", "tag": "12acc77d-6a56-426a-acda-16438c358c44"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bbd6296b-f3a0-4e8b-ae23-55da4edae5a2 req-b70a194b-0b7f-49b0-a1d5-daf191f2920d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bbd6296b-f3a0-4e8b-ae23-55da4edae5a2 req-b70a194b-0b7f-49b0-a1d5-daf191f2920d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bbd6296b-f3a0-4e8b-ae23-55da4edae5a2 req-b70a194b-0b7f-49b0-a1d5-daf191f2920d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-bbd6296b-f3a0-4e8b-ae23-55da4edae5a2 req-b70a194b-0b7f-49b0-a1d5-daf191f2920d service nova] Creating event network-vif-deleted:12acc77d-6a56-426a-acda-16438c358c44 for instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 on user Apr 12 16:06:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-bbd6296b-f3a0-4e8b-ae23-55da4edae5a2 req-b70a194b-0b7f-49b0-a1d5-daf191f2920d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094695 Apr 12 16:06:02 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 138/409] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:06:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-b6dae3b8-d882-45a7-8885-3ab155aba682 req-a17b975f-f40b-48df-a2d5-5ba14f00e5c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028431 Apr 12 16:06:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 138/410] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:04 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7a86f91a-8991-48ab-a169-216f8c465f09 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f/action" status: 202 len: 0 microversion: 2.87 time: 0.430927 Apr 12 16:06:04 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 135/411] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:06:04 2023] POST /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f/action => generated 0 bytes in 434 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:05 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:05 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:05 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9dc88fe8-7710-45a8-8de3-7b79e2746fef tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 200 len: 1763 microversion: 2.87 time: 0.251090 Apr 12 16:06:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 139/412] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:06:04 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 1763 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:06:05 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] Creating event network-vif-unplugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:06:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-146c6bf1-2062-4d3e-9c20-4dc21a7f3f3e req-c8637b6d-6f86-4a7a-a9bf-edf9919da0d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036183 Apr 12 16:06:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 139/413] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:06:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-122a67ef-bc0b-4d34-95be-778ab1b185aa req-f293a0a6-b53c-4a92-9f5b-c786400e7d4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037121 Apr 12 16:06:07 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 136/414] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:06:07 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 HTTP/1.1 Apr 12 16:06:07 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:06:07 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:06:07 user devstack@n-api.service[61657]: Connection: close Apr 12 16:06:07 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:06:07 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:06:07 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:06:07 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:06:07 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:06:07 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:06:07 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:06:07 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:06:07 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:06:07 user devstack@n-api.service[61657]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:06:07 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:06:07 user devstack@n-api.service[61657]: method: > Apr 12 16:06:07 user devstack@n-api.service[61657]: exception: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:06:07 user devstack@n-api.service[61657]: action_args: {'id': '920c6512-180d-46e1-b0cf-240d34c3fc97'} Apr 12 16:06:07 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:06:07 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:06:07 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:06:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5f657daf-f700-4e5e-b3ab-adf87d2fd152 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97" status: 404 len: 111 microversion: 2.1 time: 0.033637 Apr 12 16:06:07 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 140/415] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:07 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:06:07 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-d0be62b1-ff04-4e8a-af2c-cb48482f0179 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '.version_select at 0x7fdee786b7f0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-d0be62b1-ff04-4e8a-af2c-cb48482f0179 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-774364981" status: 202 len: 0 microversion: 2.1 time: 0.032935 Apr 12 16:06:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 140/416] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 16:06:07 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-774364981 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:06:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-533e5f09-0af3-40fd-b674-e856238b8f14 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: .version_select at 0x7fdee7728280>, body: {"keypair": {"name": "tempest-keypair-724661013", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4UqVSrXTZPE0h1pNy8WZ39Xoqx7byNd1eHVKVZr8IHkBtOGiIXjeTZ8D3+H3VbKhpwfaxKPTTKJQl1smfAloYLeCFE5oooBxOGWYDpen8kfXtiH1Xjes2DlXqlGRiLIw=="}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:08 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-533e5f09-0af3-40fd-b674-e856238b8f14 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:06:08 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-533e5f09-0af3-40fd-b674-e856238b8f14 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:06:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-533e5f09-0af3-40fd-b674-e856238b8f14 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.059522 Apr 12 16:06:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 137/417] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:06:08 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:09 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}, {"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:06:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:06:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-09861049-98b6-4c99-ae12-05d42ca1f293 req-23ae7fc4-1cb7-4032-a256-605530e0eea3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.046021 Apr 12 16:06:09 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 141/418] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1232221601", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e71b9966-9a95-4f66-b3b1-36b05d05853c"}], "security_groups": [{"name": "tempest-securitygroup--499112314"}], "key_name": "tempest-keypair-724661013", "user_data": "}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] validate_networks() for [('e71b9966-9a95-4f66-b3b1-36b05d05853c', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:06:10 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:06:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-08cfde56-c547-4ee6-9b8e-722504f28c1e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.882054 Apr 12 16:06:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 141/419] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:06:10 2023] POST /compute/v2.1/servers => generated 399 bytes in 890 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:06:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6440d1f0-53f6-4ed0-82f3-aad5d50ba864 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:11 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6440d1f0-53f6-4ed0-82f3-aad5d50ba864 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:11 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-6440d1f0-53f6-4ed0-82f3-aad5d50ba864 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:11 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6440d1f0-53f6-4ed0-82f3-aad5d50ba864 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf" status: 200 len: 1235 microversion: 2.1 time: 0.068366 Apr 12 16:06:11 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 138/420] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:11 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357dd90d-8c53-4193-ad64-edfa894116cf", "tag": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] Creating event network-changed:94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance 357dd90d-8c53-4193-ad64-edfa894116cf on user Apr 12 16:06:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-6a039674-f123-44ae-b85c-446c84fa143b req-e2a9208b-12a7-454f-bbaa-92bfff179603 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033152 Apr 12 16:06:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 142/421] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:15 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lazy-loading 'services' on Instance uuid dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:06:15 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-62d369bc-4ff2-4286-ac4c-af9736be8a7f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments/b09d128a-0198-4cfc-942f-323bd2f41d53" status: 202 len: 0 microversion: 2.1 time: 0.273045 Apr 12 16:06:15 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 142/422] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:06:15 2023] DELETE /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments/b09d128a-0198-4cfc-942f-323bd2f41d53 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8e27f0d5-63e9-4722-bf4c-a436ada44e41 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050566 Apr 12 16:06:15 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 139/423] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:06:15 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357dd90d-8c53-4193-ad64-edfa894116cf", "name": "network-vif-plugged", "status": "completed", "tag": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:16 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:16 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] Creating event network-vif-plugged:94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance 357dd90d-8c53-4193-ad64-edfa894116cf on user Apr 12 16:06:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-fc7b20bf-d7c5-45a3-afff-c5bda1467037 req-b7052141-18ab-4d5e-b95c-05e0705c2a69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033314 Apr 12 16:06:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 143/424] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:18 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357dd90d-8c53-4193-ad64-edfa894116cf", "name": "network-vif-plugged", "status": "completed", "tag": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:18 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:18 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] Creating event network-vif-plugged:94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance 357dd90d-8c53-4193-ad64-edfa894116cf on user Apr 12 16:06:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-2a1c5dfe-1a12-4cf3-8700-96f5600c8c39 req-3fa897ae-1daa-4c8b-b03f-f6cd5a821dda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063810 Apr 12 16:06:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 143/425] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1a1e4bae-1930-4ad5-93a4-759e40d74238 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113377 Apr 12 16:06:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 140/426] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:06:26 2023] GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 12 16:06:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1697600412", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "0a97bb8e-9c19-41f1-bfcd-428e3ea3492f"}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:26 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] validate_networks() for [('0a97bb8e-9c19-41f1-bfcd-428e3ea3492f', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:06:26 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1a05ef1-b072-47ea-8888-974917b35236"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting quotas for project 76f559719f5f43c3a47a0aaf1e699193. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Getting quotas for user 2b65791f14d34508b8a9a0849a9bf89e and project 76f559719f5f43c3a47a0aaf1e699193. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:06:27 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:06:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-af552783-3cc2-4b83-acde-a4c0777c34bc tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.776927 Apr 12 16:06:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 144/427] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:06:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:06:27 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-889c427d-976e-4492-b9f2-a316fe185854 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:27 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-889c427d-976e-4492-b9f2-a316fe185854 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b5a0d3b1-bdc7-4c33-b6bf-d9800ac9d9bc tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334607 Apr 12 16:06:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 144/428] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:06:26 2023] POST /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:06:27 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-889c427d-976e-4492-b9f2-a316fe185854 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-889c427d-976e-4492-b9f2-a316fe185854 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20" status: 200 len: 1212 microversion: 2.1 time: 0.102346 Apr 12 16:06:27 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 141/429] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:27 2023] GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20 => generated 1212 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1496d262-ad85-4da5-be83-035c9806bd20", "tag": "035ef219-1c48-4c0c-944d-686a6af767e5"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:30 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] Creating event network-changed:035ef219-1c48-4c0c-944d-686a6af767e5 for instance 1496d262-ad85-4da5-be83-035c9806bd20 on user Apr 12 16:06:30 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-b3773902-ec2e-4023-9dca-fc95744c196e req-95d7bff7-d68d-42e9-a572-30de6e81f50a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030667 Apr 12 16:06:30 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 145/430] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:32 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496d262-ad85-4da5-be83-035c9806bd20", "name": "network-vif-plugged", "status": "completed", "tag": "035ef219-1c48-4c0c-944d-686a6af767e5"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] Creating event network-vif-plugged:035ef219-1c48-4c0c-944d-686a6af767e5 for instance 1496d262-ad85-4da5-be83-035c9806bd20 on user Apr 12 16:06:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-1ea012fb-737d-4c3c-94ea-8f77ea0bd5bf req-e37c7e90-d866-4572-8c60-b44505d320b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042065 Apr 12 16:06:32 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 145/431] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:33 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:06:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-449c8517-a8e2-498a-9131-55b24f08c8bb tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb" status: 204 len: 0 microversion: 2.1 time: 0.154387 Apr 12 16:06:33 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 142/432] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:06:33 2023] DELETE /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:33 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e119bed0d354349b36bc6cf426e4929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b99813570054c54ada10220d1fe69ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:33 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-2ce8f5f0-d169-4f9f-971e-b2cc20c476f6 tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb" status: 200 len: 1460 microversion: 2.1 time: 0.214283 Apr 12 16:06:33 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 146/433] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:33 2023] GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb => generated 1460 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:33 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fd1e4-401b-4f73-a789-b7183f9003fb", "name": "network-vif-unplugged", "status": "completed", "tag": "7a9fa84a-39d3-4580-b205-6a75686ba943"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] Creating event network-vif-unplugged:7a9fa84a-39d3-4580-b205-6a75686ba943 for instance cb8fd1e4-401b-4f73-a789-b7183f9003fb on user Apr 12 16:06:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-43de9876-4d4e-4ad0-81a6-8eccc0826a63 req-672a1b58-0210-4621-ac48-5eb7d9064090 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031191 Apr 12 16:06:34 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 146/434] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:34 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496d262-ad85-4da5-be83-035c9806bd20", "name": "network-vif-plugged", "status": "completed", "tag": "035ef219-1c48-4c0c-944d-686a6af767e5"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:34 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] Creating event network-vif-plugged:035ef219-1c48-4c0c-944d-686a6af767e5 for instance 1496d262-ad85-4da5-be83-035c9806bd20 on user Apr 12 16:06:34 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-81402aef-b381-4a1c-a240-b26f4a571591 req-fd6720c4-b4c2-4b2a-bcac-e2b3376566ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029525 Apr 12 16:06:34 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 143/435] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:35 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:06:35 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-77f0be82-18a1-400f-9604-250ca2c73fad tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91" status: 204 len: 0 microversion: 2.1 time: 0.170111 Apr 12 16:06:35 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 147/436] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:06:34 2023] DELETE /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:35 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '584e4a8ef8c943a7a4ab711cf3adc366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9decbec41a40484b9dd236a12964a08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e75bce34-8b2c-43b9-9cb6-f8fd1db0f56f tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91" status: 200 len: 1541 microversion: 2.1 time: 0.650527 Apr 12 16:06:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 147/437] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:35 2023] GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 => generated 1541 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:36 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fd1e4-401b-4f73-a789-b7183f9003fb", "name": "network-vif-plugged", "status": "completed", "tag": "7a9fa84a-39d3-4580-b205-6a75686ba943"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] Creating event network-vif-plugged:7a9fa84a-39d3-4580-b205-6a75686ba943 for instance cb8fd1e4-401b-4f73-a789-b7183f9003fb on user Apr 12 16:06:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-4edb9761-c6ea-4317-84dd-55b68fe314a8 req-8895baaa-03eb-4ff7-b0da-871bc8165c35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044430 Apr 12 16:06:36 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 144/438] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:36 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb8fd1e4-401b-4f73-a789-b7183f9003fb", "name": "network-vif-deleted", "tag": "7a9fa84a-39d3-4580-b205-6a75686ba943"}, {"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}, {"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-plugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Creating event network-vif-deleted:7a9fa84a-39d3-4580-b205-6a75686ba943 for instance cb8fd1e4-401b-4f73-a789-b7183f9003fb on user Apr 12 16:06:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Creating event network-vif-unplugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:06:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] Creating event network-vif-plugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:06:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-20a66064-41ea-4b04-8897-dffb25810aed req-f53e5baf-cc73-4a12-96c3-395e2c28a2e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.068839 Apr 12 16:06:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 148/439] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:36 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:37 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5d2a9cf4-938a-45a8-965e-d7c9ff413f5f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '.version_select at 0x7fdee7b7c3a0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:37 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5d2a9cf4-938a-45a8-965e-d7c9ff413f5f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4" status: 200 len: 1722 microversion: 2.1 time: 0.062554 Apr 12 16:06:37 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 148/440] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 16:06:37 2023] GET /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4 => generated 1722 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:37 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:37 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2cba0698-bda7-4dc6-acc9-9c92fafff5b9 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '.version_select at 0x7fdee772b0a0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2cba0698-bda7-4dc6-acc9-9c92fafff5b9 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4" status: 200 len: 1722 microversion: 2.1 time: 0.056765 Apr 12 16:06:37 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 145/441] 10.0.0.210 () {62 vars in 1310 bytes} [Wed Apr 12 16:06:37 2023] GET /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4 => generated 1722 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:38 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:38 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f9422616-1c38-4cdd-8b1c-24a075555c39 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 200 len: 1673 microversion: 2.1 time: 0.284297 Apr 12 16:06:38 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 149/442] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:37 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 1673 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:38 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-plugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}, {"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-plugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}, {"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-unplugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}, {"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-plugged", "status": "completed", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}, {"server_uuid": "7835bdfc-77dc-4407-8a0a-ef81eca29c91", "name": "network-vif-deleted", "tag": "d0b3ae35-a6cc-416c-86a7-6ea400e14660"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Creating event network-vif-plugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:06:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Creating event network-vif-plugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:06:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Creating event network-vif-unplugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:06:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Creating event network-vif-plugged:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:06:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] Creating event network-vif-deleted:d0b3ae35-a6cc-416c-86a7-6ea400e14660 for instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 on user Apr 12 16:06:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-e5ede8f6-f0df-4f3b-9807-838025477c4e req-b5f9b9f6-78af-4e3a-bd2b-abef19564ba5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.042716 Apr 12 16:06:38 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 149/443] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:38 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] [instance: 85b91251-9735-4812-9f11-003a7951a6f3] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] HTTP exception thrown: Instance 85b91251-9735-4812-9f11-003a7951a6f3 could not be found. Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Request method failure captured: Apr 12 16:06:45 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 HTTP/1.1 Apr 12 16:06:45 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:06:45 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:06:45 user devstack@n-api.service[61659]: Connection: close Apr 12 16:06:45 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:06:45 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:06:45 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:06:45 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:06:45 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtV2J9qnYcCwjhUAXKpYxB9jC7_1ND-Yzcg-MTbEjv6nCbjct58J2S8_dDOG9riQd9b47PhFoy5UEUf1BqcHW1Qer4th0MXAA4KyYXe90S-Sg449K8fG8u5HIeJYbALoWhApbNm3cYwxZZQnHnmxCp5wFCZqAyp4mYalhWGyLGer8_I Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Project-Id: a46b4e80a65541d6bab94b5edfc26e5b Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestShelveInstance-346701715 Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a46b4e80a65541d6bab94b5edfc26e5b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a46b4e80a65541d6bab94b5edfc26e5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a46b4e80a65541d6bab94b5edfc26e5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Tenant: tempest-TestShelveInstance-346701715 Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Tenant-Id: a46b4e80a65541d6bab94b5edfc26e5b Apr 12 16:06:45 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestShelveInstance-346701715 Apr 12 16:06:45 user devstack@n-api.service[61659]: X-User: tempest-TestShelveInstance-346701715-project-member Apr 12 16:06:45 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:06:45 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:06:45 user devstack@n-api.service[61659]: X-User-Id: 6acbd977c4b4494db95f879777184489 Apr 12 16:06:45 user devstack@n-api.service[61659]: X-User-Name: tempest-TestShelveInstance-346701715-project-member Apr 12 16:06:45 user devstack@n-api.service[61659]: method: > Apr 12 16:06:45 user devstack@n-api.service[61659]: exception: Instance 85b91251-9735-4812-9f11-003a7951a6f3 could not be found. Apr 12 16:06:45 user devstack@n-api.service[61659]: action_args: {'id': '85b91251-9735-4812-9f11-003a7951a6f3'} Apr 12 16:06:45 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85b91251-9735-4812-9f11-003a7951a6f3 could not be found. Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85b91251-9735-4812-9f11-003a7951a6f3 could not be found. Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85b91251-9735-4812-9f11-003a7951a6f3 could not be found. Apr 12 16:06:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Returning 404 to user: Instance 85b91251-9735-4812-9f11-003a7951a6f3 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:06:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a06b94e7-2c7e-47e6-a2e9-98849166892c tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3" status: 404 len: 111 microversion: 2.1 time: 0.029391 Apr 12 16:06:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 146/444] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:45 2023] GET /compute/v2.1/servers/85b91251-9735-4812-9f11-003a7951a6f3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:06:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c8ca7d14-430d-4643-9db8-e5fb6ef64fc4 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] Calling method '.version_select at 0x7fdee7783370>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c8ca7d14-430d-4643-9db8-e5fb6ef64fc4 tempest-TestShelveInstance-346701715 tempest-TestShelveInstance-346701715-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-509475392" status: 202 len: 0 microversion: 2.1 time: 0.035471 Apr 12 16:06:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 150/445] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:06:45 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-509475392 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:48 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:48 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e95bab6b-948c-483f-8d1a-c36f4194b6ee tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 200 len: 1504 microversion: 2.1 time: 0.307899 Apr 12 16:06:48 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 150/446] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:06:47 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:49 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] HTTP exception thrown: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Request method failure captured: Apr 12 16:06:49 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 HTTP/1.1 Apr 12 16:06:49 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:06:49 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:06:49 user devstack@n-api.service[61659]: Connection: close Apr 12 16:06:49 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:06:49 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:06:49 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:06:49 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:06:49 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVXTjbZyEg_LmQ8Bw4CRXe_aQ4Io08dmEqiq6DckeHL3labzmb0ucJ2h2alwuZ20sdvv-eJLGhEqIK5nt30N8nNaa6-_29GU64tUxEQo1PWr3GGx_x7Tuo6hglRY7wblhnOzAk_wGgQ-8En_mDySIXGvccofwCJlhlruOYkLCn3Z6Q Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Project-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Tenant-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:06:49 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:06:49 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:06:49 user devstack@n-api.service[61659]: X-User-Id: c1abec24caf74dc8a27b64c21a9d4a59 Apr 12 16:06:49 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:06:49 user devstack@n-api.service[61659]: method: > Apr 12 16:06:49 user devstack@n-api.service[61659]: exception: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:06:49 user devstack@n-api.service[61659]: action_args: {'id': 'fc19fd8d-3285-4ceb-8714-a0ba139f3045'} Apr 12 16:06:49 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:06:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:06:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Returning 404 to user: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:06:49 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-0a32f6d7-f1be-46a9-8794-ae7e2104151c tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 404 len: 111 microversion: 2.20 time: 0.033288 Apr 12 16:06:49 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 147/447] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:06:49 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:06:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-32cae8b4-252d-46a5-b1d8-6a12975b749a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '.version_select at 0x7fdee77e09d0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-32cae8b4-252d-46a5-b1d8-6a12975b749a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362669684" status: 204 len: 0 microversion: 2.20 time: 0.029742 Apr 12 16:06:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 151/448] 10.0.0.210 () {64 vars in 1339 bytes} [Wed Apr 12 16:06:49 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362669684 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:06:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-bce3931f-885b-4702-8fa0-3dd70c001d3e tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'create', calling method: .version_select at 0x7fdee7701a20>, body: {"keypair": {"name": "tempest-keypair-746668212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqm4X1GPAEsvdMh1GO761bXVv1VUyRSugyouG8rhVils1/hHVrIYx63R3qDcmpgztzn8AC8dxMFAH78ymrOF6BZDB1CDRnw9cjgtplakD6t2lDEw7VFcHyaQTdxPCChxA=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:50 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=14 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:50 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-bce3931f-885b-4702-8fa0-3dd70c001d3e tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:06:50 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-bce3931f-885b-4702-8fa0-3dd70c001d3e tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for user c1abec24caf74dc8a27b64c21a9d4a59 and project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:06:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-bce3931f-885b-4702-8fa0-3dd70c001d3e tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.062611 Apr 12 16:06:50 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 151/449] 10.0.0.210 () {66 vars in 1277 bytes} [Wed Apr 12 16:06:50 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 64 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 12 16:06:52 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-555700697", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "eb4dd4b5-96d4-4b53-b510-d41e2775b92f"}], "security_groups": [{"name": "tempest-securitygroup--1050764157"}], "key_name": "tempest-keypair-746668212", "user_data": "}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:52 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] validate_networks() for [('eb4dd4b5-96d4-4b53-b510-d41e2775b92f', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Getting quotas for user c1abec24caf74dc8a27b64c21a9d4a59 and project 1fa122cbabe94c6f93c862b4daf31e50. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:06:53 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:06:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c5b32526-554a-4a9b-ad13-2985b23b796f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.728507 Apr 12 16:06:53 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 148/450] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 16:06:52 2023] POST /compute/v2.1/servers => generated 400 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 16:06:53 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5d4188fb-0649-4b59-87b5-c1350e8db1b8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:53 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5d4188fb-0649-4b59-87b5-c1350e8db1b8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:53 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5d4188fb-0649-4b59-87b5-c1350e8db1b8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:53 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5d4188fb-0649-4b59-87b5-c1350e8db1b8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:53 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5d4188fb-0649-4b59-87b5-c1350e8db1b8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5d4188fb-0649-4b59-87b5-c1350e8db1b8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 200 len: 1274 microversion: 2.20 time: 0.081306 Apr 12 16:06:53 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 152/451] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:06:53 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 1274 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:55 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:06:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-709753b1-73bf-4329-9c11-c3e2eb436675 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 200 len: 1769 microversion: 2.87 time: 0.178027 Apr 12 16:06:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 152/452] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:06:55 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 1769 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:06:56 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:56 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] Creating event network-changed:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:06:56 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-3ec253d3-7d5f-4bc2-b0ff-41f2aed99361 req-d9ce6b63-cab3-425a-b335-5fd9487f0483 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034196 Apr 12 16:06:56 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 149/453] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:06:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-plugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:06:58 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:06:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:06:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:06:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:06:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] Creating event network-vif-plugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:06:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-c6fe85b1-d657-41f2-9f2e-dab50b2ad236 req-b46a5674-eafe-41d6-b48e-165cc8832e01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043417 Apr 12 16:06:58 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 153/454] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:06:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-plugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] Creating event network-vif-plugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:07:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-0583a55d-50fd-4ad7-855a-d7997e0d424a req-8e9ab1fb-6f7d-489e-93d1-aa5662accbed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Apr 12 16:07:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 153/455] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:01 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-0f8060d5-49d2-43d1-aac7-89df45b82b56 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf" status: 200 len: 1543 microversion: 2.1 time: 0.188360 Apr 12 16:07:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 150/456] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:01 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf => generated 1543 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7c3c9760-5f6c-400b-a564-ecb7bc466d25 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051279 Apr 12 16:07:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 154/457] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:07:05 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:05 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-cfb54a4a-7e79-40dd-9121-cf66478882cd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1675 microversion: 2.1 time: 0.140731 Apr 12 16:07:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 154/458] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:05 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1675 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:05 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c5eb998f-38cc-47ca-8b88-a79bcab9b2d4 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1675 microversion: 2.1 time: 0.196204 Apr 12 16:07:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 151/459] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:05 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:06 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-26fc582d-49ee-4e68-864c-8de435fef9d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1675 microversion: 2.1 time: 0.204977 Apr 12 16:07:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 155/460] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:05 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-66b881ae-06fb-43ab-886e-889b379689ed tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Action: 'create', calling method: .version_select at 0x7fdee786b760>, body: {"keypair": {"name": "tempest-TestStampPattern-1321754823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM9rCdORWoFaEzbUsNhuoBFSyjDv4K5w82ZJzoi+0Rba6d3tv8xkR5nGe+5wcm9lUrYy4FRmQCBzLyX7FSGTRKcYmN9F41l7pVMhhHvTYmD+PQt4JX5BTIQ1nRCFqJvvxg=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:08 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-66b881ae-06fb-43ab-886e-889b379689ed tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting quotas for project a77372a5e83c4fc882b0a0b0eea46f06. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:07:08 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-66b881ae-06fb-43ab-886e-889b379689ed tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting quotas for user 5e0ffc0972674609b17fe2780751dfc5 and project a77372a5e83c4fc882b0a0b0eea46f06. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:07:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-66b881ae-06fb-43ab-886e-889b379689ed tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.244084 Apr 12 16:07:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 155/461] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:07:08 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1441208586", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1321754823", "security_groups": [{"name": "tempest-secgroup-smoke-506862283"}], "networks": [{"uuid": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] validate_networks() for [('1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting quotas for project a77372a5e83c4fc882b0a0b0eea46f06. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting quotas for user 5e0ffc0972674609b17fe2780751dfc5 and project a77372a5e83c4fc882b0a0b0eea46f06. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:07:11 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:07:11 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f9ac6fb4-da4b-4ae3-ac19-e50438fbe57b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.734408 Apr 12 16:07:11 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 152/462] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:07:11 2023] POST /compute/v2.1/servers => generated 403 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:07:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a3bb9db7-012a-4051-80f9-cbc04785bf11 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a3bb9db7-012a-4051-80f9-cbc04785bf11 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:12 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a3bb9db7-012a-4051-80f9-cbc04785bf11 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a3bb9db7-012a-4051-80f9-cbc04785bf11 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab" status: 200 len: 1237 microversion: 2.1 time: 0.065469 Apr 12 16:07:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 156/463] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:12 2023] GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] Creating event network-changed:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:07:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-ddd89596-d622-4300-8f62-50af78f71f87 req-308175ea-f8c1-4b88-ba3b-cf62e4768846 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033026 Apr 12 16:07:14 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 156/464] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "name": "network-vif-plugged", "status": "completed", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] Creating event network-vif-plugged:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:07:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-20c15c77-a04e-4095-b897-249230147b66 req-3b5477ea-d42e-4fe6-b83e-c146fc1bdb78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037009 Apr 12 16:07:16 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 153/465] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=14 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:17 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-b5e39610-dfa5-46e4-8b29-607d46db4700 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20" status: 200 len: 1493 microversion: 2.1 time: 0.198917 Apr 12 16:07:17 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 157/466] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:17 2023] GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20 => generated 1493 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:18 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "name": "network-vif-plugged", "status": "completed", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:18 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] Creating event network-vif-plugged:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:07:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-539b24c2-04f9-4968-aff9-4bf1806cfd77 req-b835544d-6d20-49d7-9c62-b96c8777fb1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030404 Apr 12 16:07:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 157/467] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] [instance: cb8fd1e4-401b-4f73-a789-b7183f9003fb] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] HTTP exception thrown: Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb could not be found. Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Request method failure captured: Apr 12 16:07:23 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb HTTP/1.1 Apr 12 16:07:23 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:07:23 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:07:23 user devstack@n-api.service[61659]: Connection: close Apr 12 16:07:23 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:07:23 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:07:23 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:07:23 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:07:23 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtaY7O5PngaIyDh4g2YGTMOh7BMWmR0-mwXkJTk2x0yFA-PAuYnqTIpHa9AQYZqiSUiiugrMy-dCWvoh6IyyGC2pH0zGXK_3kjjA7FegSfzwnbJEEyxt_SUC5jSgAGRt2TdiOuF-nkGO9YnYxRzgvqGJhmwaAcEDEX-KvdBLKgD7A0s Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Project-Id: 1b99813570054c54ada10220d1fe69ae Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesNegativeTest-877189983 Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1b99813570054c54ada10220d1fe69ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b99813570054c54ada10220d1fe69ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1b99813570054c54ada10220d1fe69ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesNegativeTest-877189983 Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Tenant-Id: 1b99813570054c54ada10220d1fe69ae Apr 12 16:07:23 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesNegativeTest-877189983 Apr 12 16:07:23 user devstack@n-api.service[61659]: X-User: tempest-VolumesNegativeTest-877189983-project-member Apr 12 16:07:23 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:07:23 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:07:23 user devstack@n-api.service[61659]: X-User-Id: 4e119bed0d354349b36bc6cf426e4929 Apr 12 16:07:23 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesNegativeTest-877189983-project-member Apr 12 16:07:23 user devstack@n-api.service[61659]: method: > Apr 12 16:07:23 user devstack@n-api.service[61659]: exception: Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb could not be found. Apr 12 16:07:23 user devstack@n-api.service[61659]: action_args: {'id': 'cb8fd1e4-401b-4f73-a789-b7183f9003fb'} Apr 12 16:07:23 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb could not be found. Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb could not be found. Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb could not be found. Apr 12 16:07:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] Returning 404 to user: Instance cb8fd1e4-401b-4f73-a789-b7183f9003fb could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:07:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d516dce8-da47-4bd6-bce2-d4cca9dbdf1a tempest-VolumesNegativeTest-877189983 tempest-VolumesNegativeTest-877189983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb" status: 404 len: 111 microversion: 2.1 time: 0.030350 Apr 12 16:07:23 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 154/468] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:23 2023] GET /compute/v2.1/servers/cb8fd1e4-401b-4f73-a789-b7183f9003fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] HTTP exception thrown: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Request method failure captured: Apr 12 16:07:25 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 HTTP/1.1 Apr 12 16:07:25 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:07:25 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:07:25 user devstack@n-api.service[61657]: Connection: close Apr 12 16:07:25 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:07:25 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:07:25 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:07:25 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:07:25 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtaSz0rN9In8E4WgS392Ho9T1vLLndgto_mP2YCc-2N8QgrAJY1fkgYAAGFCV4hlo_XrxvuYFwK2yWmvInOT6CBPqqwbcKr6Dgi_RbFYTdd_vEdgnHglmx_3UHhSoNLSDJQNhU4Y7UYYkXhRfD6Y5soYPnQjn44xmn-K1DdoXOjS6tY Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Project-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Project-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Tenant: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Tenant-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:25 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:25 user devstack@n-api.service[61657]: X-User: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:25 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:07:25 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:07:25 user devstack@n-api.service[61657]: X-User-Id: 584e4a8ef8c943a7a4ab711cf3adc366 Apr 12 16:07:25 user devstack@n-api.service[61657]: X-User-Name: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:25 user devstack@n-api.service[61657]: method: > Apr 12 16:07:25 user devstack@n-api.service[61657]: exception: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:25 user devstack@n-api.service[61657]: action_args: {'id': '7835bdfc-77dc-4407-8a0a-ef81eca29c91'} Apr 12 16:07:25 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Returning 404 to user: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:07:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7688297f-0482-422a-b7b4-08afff4f965a tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91" status: 404 len: 111 microversion: 2.1 time: 0.050604 Apr 12 16:07:25 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 158/469] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:25 2023] GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=18 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] HTTP exception thrown: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Request method failure captured: Apr 12 16:07:26 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91/os-volume_attachments HTTP/1.1 Apr 12 16:07:26 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:07:26 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:07:26 user devstack@n-api.service[61658]: Connection: close Apr 12 16:07:26 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:07:26 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:07:26 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:07:26 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:07:26 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtaSz0rN9In8E4WgS392Ho9T1vLLndgto_mP2YCc-2N8QgrAJY1fkgYAAGFCV4hlo_XrxvuYFwK2yWmvInOT6CBPqqwbcKr6Dgi_RbFYTdd_vEdgnHglmx_3UHhSoNLSDJQNhU4Y7UYYkXhRfD6Y5soYPnQjn44xmn-K1DdoXOjS6tY Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Project-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Project-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Tenant: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Tenant-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:26 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:26 user devstack@n-api.service[61658]: X-User: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:26 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:07:26 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:07:26 user devstack@n-api.service[61658]: X-User-Id: 584e4a8ef8c943a7a4ab711cf3adc366 Apr 12 16:07:26 user devstack@n-api.service[61658]: X-User-Name: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:26 user devstack@n-api.service[61658]: method: > Apr 12 16:07:26 user devstack@n-api.service[61658]: exception: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:26 user devstack@n-api.service[61658]: action_args: {'server_id': '7835bdfc-77dc-4407-8a0a-ef81eca29c91'} Apr 12 16:07:26 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:07:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Returning 404 to user: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:07:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4da471eb-af56-435a-bb56-6d1f969fccae tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.048920 Apr 12 16:07:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 158/470] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:07:26 2023] GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] HTTP exception thrown: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Request method failure captured: Apr 12 16:07:28 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 HTTP/1.1 Apr 12 16:07:28 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:07:28 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:07:28 user devstack@n-api.service[61659]: Connection: close Apr 12 16:07:28 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:07:28 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:07:28 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:07:28 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:07:28 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtaSz0rN9In8E4WgS392Ho9T1vLLndgto_mP2YCc-2N8QgrAJY1fkgYAAGFCV4hlo_XrxvuYFwK2yWmvInOT6CBPqqwbcKr6Dgi_RbFYTdd_vEdgnHglmx_3UHhSoNLSDJQNhU4Y7UYYkXhRfD6Y5soYPnQjn44xmn-K1DdoXOjS6tY Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Project-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Project-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Tenant: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Tenant-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:28 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:28 user devstack@n-api.service[61659]: X-User: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:28 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:07:28 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:07:28 user devstack@n-api.service[61659]: X-User-Id: 584e4a8ef8c943a7a4ab711cf3adc366 Apr 12 16:07:28 user devstack@n-api.service[61659]: X-User-Name: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:28 user devstack@n-api.service[61659]: method: > Apr 12 16:07:28 user devstack@n-api.service[61659]: exception: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61659]: action_args: {'id': '7835bdfc-77dc-4407-8a0a-ef81eca29c91'} Apr 12 16:07:28 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Returning 404 to user: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:07:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-62474870-09de-45d2-82da-dd0534f6a23d tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91" status: 404 len: 111 microversion: 2.1 time: 0.042552 Apr 12 16:07:28 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 155/471] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:07:28 2023] DELETE /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] [instance: 7835bdfc-77dc-4407-8a0a-ef81eca29c91] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] HTTP exception thrown: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Request method failure captured: Apr 12 16:07:28 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 HTTP/1.1 Apr 12 16:07:28 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:07:28 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:07:28 user devstack@n-api.service[61657]: Connection: close Apr 12 16:07:28 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:07:28 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:07:28 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:07:28 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:07:28 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtaSz0rN9In8E4WgS392Ho9T1vLLndgto_mP2YCc-2N8QgrAJY1fkgYAAGFCV4hlo_XrxvuYFwK2yWmvInOT6CBPqqwbcKr6Dgi_RbFYTdd_vEdgnHglmx_3UHhSoNLSDJQNhU4Y7UYYkXhRfD6Y5soYPnQjn44xmn-K1DdoXOjS6tY Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Project-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Project-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9decbec41a40484b9dd236a12964a08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Tenant: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Tenant-Id: 9decbec41a40484b9dd236a12964a08a Apr 12 16:07:28 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-DeleteServersTestJSON-1867736040 Apr 12 16:07:28 user devstack@n-api.service[61657]: X-User: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:28 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:07:28 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:07:28 user devstack@n-api.service[61657]: X-User-Id: 584e4a8ef8c943a7a4ab711cf3adc366 Apr 12 16:07:28 user devstack@n-api.service[61657]: X-User-Name: tempest-DeleteServersTestJSON-1867736040-project-member Apr 12 16:07:28 user devstack@n-api.service[61657]: method: > Apr 12 16:07:28 user devstack@n-api.service[61657]: exception: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61657]: action_args: {'id': '7835bdfc-77dc-4407-8a0a-ef81eca29c91'} Apr 12 16:07:28 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. Apr 12 16:07:28 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:07:28 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] Returning 404 to user: Instance 7835bdfc-77dc-4407-8a0a-ef81eca29c91 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:07:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5cb13784-ca9e-4f9a-8a0b-78072bca0290 tempest-DeleteServersTestJSON-1867736040 tempest-DeleteServersTestJSON-1867736040-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91" status: 404 len: 111 microversion: 2.1 time: 0.035449 Apr 12 16:07:28 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 159/472] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:28 2023] GET /compute/v2.1/servers/7835bdfc-77dc-4407-8a0a-ef81eca29c91 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:38 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6aa00961-becd-428b-a7ea-bba2aac58388 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 200 len: 1673 microversion: 2.1 time: 0.166278 Apr 12 16:07:38 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 159/473] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:38 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cc863d9-b797-4b5b-b8ce-30ebe55b9519"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=19 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:40 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d97aea9b-ae6b-4e64-9239-62f759df67a5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289100 Apr 12 16:07:40 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 156/474] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:07:40 2023] POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=15 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=10 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:43 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:43 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ac927353-475d-44fd-a56b-29dc4a530476 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 200 len: 1585 microversion: 2.20 time: 0.157932 Apr 12 16:07:43 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 160/475] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:07:43 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 1585 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "7cf43834-8139-44fb-a821-3bb62ca931b4"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:47 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'flavor' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:07:48 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-395dc8ac-4fab-4487-be2c-61a015fcb029 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/action" status: 200 len: 29 microversion: 2.1 time: 0.254949 Apr 12 16:07:48 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 160/476] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:07:47 2023] POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/action => generated 29 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:48 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f5eab5cb-8272-497f-a1af-162f90ae5dd5 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 200 len: 1725 microversion: 2.1 time: 0.223468 Apr 12 16:07:48 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 157/477] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:48 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-unplugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] Creating event network-vif-unplugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:07:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-9d10ca12-3259-49b3-8dd8-28581c7fda56 req-03b88d94-fd7c-4e18-8f2c-ce580fa5be81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045380 Apr 12 16:07:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 161/478] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-0468167a-b13b-4bd1-bf8c-a07765ae2c6a tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'create', calling method: .version_select at 0x7fdee7868820>, body: {"keypair": {"name": "tempest-keypair-1217848071", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrkO3n8O4MAhGHzu305sUcOksNuZEgf5S2SaBBr3Crg5JA/Jbvt/iKbwzA0RYiZC3er8snS/bVFp1ZVLE3mVV6weKk+F4a0jnCrqA1XiOQQWJzF35GqBgQiIFDFUaocAg=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:49 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-0468167a-b13b-4bd1-bf8c-a07765ae2c6a tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:07:49 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-0468167a-b13b-4bd1-bf8c-a07765ae2c6a tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for user 880266e3fa4d4dd889648c10208a1f8e and project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:07:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-0468167a-b13b-4bd1-bf8c-a07765ae2c6a tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057950 Apr 12 16:07:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 161/479] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:07:49 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:51 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:07:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-ba07a94d-3f03-413c-9a4b-7c9770588430 req-9bfbd49b-7d5e-4154-b725-8f7ab8bb1d8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029236 Apr 12 16:07:51 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 158/480] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1180614007", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "06fae0be-02dd-4962-a1ac-fd0413772758"}], "security_groups": [{"name": "tempest-securitygroup--1574424249"}], "key_name": "tempest-keypair-1217848071", "user_data": "}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] validate_networks() for [('06fae0be-02dd-4962-a1ac-fd0413772758', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:07:51 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Getting quotas for user 880266e3fa4d4dd889648c10208a1f8e and project b3fe48a3b7d846a195f1e47cc7f69695. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:07:52 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:07:52 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:07:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a5d4f90e-c5b9-4263-b06f-5f7d81fe40b9 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.576991 Apr 12 16:07:52 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 162/481] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:07:51 2023] POST /compute/v2.1/servers => generated 407 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:07:52 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c26e6afe-b350-4e97-ba11-b8dc877e2116 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:52 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c26e6afe-b350-4e97-ba11-b8dc877e2116 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:52 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c26e6afe-b350-4e97-ba11-b8dc877e2116 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:52 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c26e6afe-b350-4e97-ba11-b8dc877e2116 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 200 len: 1240 microversion: 2.1 time: 0.073212 Apr 12 16:07:52 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 162/482] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:07:52 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:07:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:07:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-3d63f467-9779-496e-9db2-b15babbe89fd req-9e56f72b-2bfd-47d7-a4ad-25a201555e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031084 Apr 12 16:07:53 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 159/483] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:55 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1903529512", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "b36306e0-04c5-4b1b-8022-05ff121c4e43"}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:55 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] validate_networks() for [('b36306e0-04c5-4b1b-8022-05ff121c4e43', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:07:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:07:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-b6d63918-c675-49e1-9d27-e01b64dddc6b req-db8e3e6a-27d0-4b8d-804c-319c495e4cfe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033217 Apr 12 16:07:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 163/484] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] Creating event network-changed:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:07:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-cfa1e9dc-929f-4181-af74-6ecc9cb1e9ff req-68e941ec-0589-4ffc-ac00-2107f1f56c9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034889 Apr 12 16:07:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 160/485] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for user 73f9fa5bc22a4824b3cdcb8cf7bb380c and project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:07:56 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:07:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3720f937-dabf-47ac-bd0b-7dee391810d2 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.539170 Apr 12 16:07:56 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 163/486] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 16:07:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 16:07:56 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-faf60395-d306-447b-8020-7f7799bfb55d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:07:56 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-faf60395-d306-447b-8020-7f7799bfb55d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:07:56 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-faf60395-d306-447b-8020-7f7799bfb55d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:56 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-faf60395-d306-447b-8020-7f7799bfb55d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:56 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-faf60395-d306-447b-8020-7f7799bfb55d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:07:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-faf60395-d306-447b-8020-7f7799bfb55d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c" status: 200 len: 1395 microversion: 2.87 time: 0.109860 Apr 12 16:07:56 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 164/487] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:07:56 2023] GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c => generated 1395 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:07:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:07:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-5f04b3d5-f407-41c7-a162-52d23723fa7e req-76af3452-c78c-4976-888a-8f430af0731d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090013 Apr 12 16:07:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 161/488] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:07:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016ae41d-b098-4126-ace7-3da00b40cb9c", "tag": "6aeec58e-a9ce-429d-a931-f860d7352c2e"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:07:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:07:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:07:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:07:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] Creating event network-changed:6aeec58e-a9ce-429d-a931-f860d7352c2e for instance 016ae41d-b098-4126-ace7-3da00b40cb9c on user Apr 12 16:07:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-bfbc0889-5606-4e59-8147-41f0726ded81 req-1fed4131-ee39-4052-b568-27aaa1556047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033316 Apr 12 16:07:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 164/489] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:07:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:08:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-33a2e7eb-4c36-44fd-a27c-108b924f68b6 req-546ef2f2-87cf-493f-9016-067f82878a5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031808 Apr 12 16:08:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 165/490] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-ab6160ee-1266-4429-b43f-2d9e46c00914 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.146356 Apr 12 16:08:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 162/491] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:08:01 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-interface => generated 282 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ae41d-b098-4126-ace7-3da00b40cb9c", "name": "network-vif-plugged", "status": "completed", "tag": "6aeec58e-a9ce-429d-a931-f860d7352c2e"}, {"server_uuid": "016ae41d-b098-4126-ace7-3da00b40cb9c", "name": "network-vif-plugged", "status": "completed", "tag": "6aeec58e-a9ce-429d-a931-f860d7352c2e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:02 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Creating event network-vif-plugged:6aeec58e-a9ce-429d-a931-f860d7352c2e for instance 016ae41d-b098-4126-ace7-3da00b40cb9c on user Apr 12 16:08:02 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] Creating event network-vif-plugged:6aeec58e-a9ce-429d-a931-f860d7352c2e for instance 016ae41d-b098-4126-ace7-3da00b40cb9c on user Apr 12 16:08:02 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-de5e8200-a756-427f-bbc9-9f89c958175d req-34ff65a3-ddbb-4801-9c25-9987cdde0ce8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035003 Apr 12 16:08:02 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 166/492] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:02 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-41ae45da-e3ed-45ba-9bdd-d0e03e2c1a46 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab" status: 200 len: 1538 microversion: 2.1 time: 0.349909 Apr 12 16:08:02 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 165/493] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:08:02 2023] GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab => generated 1538 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:08:02 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357dd90d-8c53-4193-ad64-edfa894116cf", "tag": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] Creating event network-changed:94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance 357dd90d-8c53-4193-ad64-edfa894116cf on user Apr 12 16:08:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-5b2bff57-de44-4175-a756-ffdaa8711c7a req-514b7f76-26a6-4ba0-9b12-1f9433309c9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077071 Apr 12 16:08:02 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 163/494] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e3ecd082-16cf-4c6d-8798-0e37bc34b98e tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/ips" status: 200 len: 107 microversion: 2.1 time: 0.085252 Apr 12 16:08:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 167/495] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:08:02 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/ips => generated 107 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "689dae55-b0ff-4639-85a0-96a3a0425490"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a17d3732-4066-4cbe-a74b-444bd3bf9e94 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309044 Apr 12 16:08:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 166/496] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:08:05 2023] POST /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:07 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-13918bab-8d2f-4a39-b40b-95a71514612d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1675 microversion: 2.1 time: 0.241755 Apr 12 16:08:07 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 164/497] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:08:07 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9baf883b-de18-43f0-a9d8-fc850bd83297"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=8 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2a8014ee-185e-43a2-9fe9-7b3942cac4ae tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.409659 Apr 12 16:08:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 168/498] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:08:07 2023] POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments => generated 194 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=12 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "689dae55-b0ff-4639-85a0-96a3a0425490"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Invalid volume: volume 689dae55-b0ff-4639-85a0-96a3a0425490 is already attached to instances: 357dd90d-8c53-4193-ad64-edfa894116cf Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:08:13 user devstack@n-api.service[61657]: request: POST /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments HTTP/1.1 Apr 12 16:08:13 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:08:13 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:08:13 user devstack@n-api.service[61657]: Connection: close Apr 12 16:08:13 user devstack@n-api.service[61657]: Content-Length: 74 Apr 12 16:08:13 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:08:13 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:08:13 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:08:13 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:08:13 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:08:13 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:08:13 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:08:13 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:08:13 user devstack@n-api.service[61657]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:08:13 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:08:13 user devstack@n-api.service[61657]: Apr 12 16:08:13 user devstack@n-api.service[61657]: {"volumeAttachment": {"volumeId": "689dae55-b0ff-4639-85a0-96a3a0425490"}} Apr 12 16:08:13 user devstack@n-api.service[61657]: method: > Apr 12 16:08:13 user devstack@n-api.service[61657]: exception: Invalid volume: volume 689dae55-b0ff-4639-85a0-96a3a0425490 is already attached to instances: 357dd90d-8c53-4193-ad64-edfa894116cf Apr 12 16:08:13 user devstack@n-api.service[61657]: action_args: {'server_id': '357dd90d-8c53-4193-ad64-edfa894116cf', 'body': {'volumeAttachment': {'volumeId': '689dae55-b0ff-4639-85a0-96a3a0425490'}}} Apr 12 16:08:13 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 689dae55-b0ff-4639-85a0-96a3a0425490 is already attached to instances: 357dd90d-8c53-4193-ad64-edfa894116cf Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 689dae55-b0ff-4639-85a0-96a3a0425490 is already attached to instances: 357dd90d-8c53-4193-ad64-edfa894116cf Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 689dae55-b0ff-4639-85a0-96a3a0425490 is already attached to instances: 357dd90d-8c53-4193-ad64-edfa894116cf Apr 12 16:08:13 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:08:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 400 to user: Invalid volume: volume 689dae55-b0ff-4639-85a0-96a3a0425490 is already attached to instances: 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:08:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-6edfb74a-d930-4a57-89f2-6eecfe2d789f tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152304 Apr 12 16:08:13 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 167/499] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:08:13 2023] POST /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=19 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:13 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'services' on Instance uuid 357dd90d-8c53-4193-ad64-edfa894116cf {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:08:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-fbdc18cd-3ae4-4726-a182-1cfe749bcebc tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments/689dae55-b0ff-4639-85a0-96a3a0425490" status: 202 len: 0 microversion: 2.1 time: 0.216485 Apr 12 16:08:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 165/500] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:08:13 2023] DELETE /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments/689dae55-b0ff-4639-85a0-96a3a0425490 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6246ee33-b3e7-4df5-b310-288121be59bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067674 Apr 12 16:08:14 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 169/501] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:08:13 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:15 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:15 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Old instance type m1.nano, new instance type m1.micro {{(pid=61657) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for user 1a699b3ba8304eadb8a53d465ea340cf and project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:08:16 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:08:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d2786bdf-de77-4630-8042-473ec470ccce tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.415959 Apr 12 16:08:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 168/502] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:08:15 2023] POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:17 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:17 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-3b552ad8-bc5c-44aa-a280-fcf34387b053 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1730 microversion: 2.1 time: 0.715032 Apr 12 16:08:17 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 166/503] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:08:16 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1730 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "ce7eea7f-3b98-420f-8248-efa9422249ab"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:19 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] HTTP exception thrown: Volume 4d5b5ec0-468c-4861-a6ba-448372687ac2 could not be found. Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Request method failure captured: Apr 12 16:08:19 user devstack@n-api.service[61658]: request: PUT /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20/os-volume_attachments/4d5b5ec0-468c-4861-a6ba-448372687ac2 HTTP/1.1 Apr 12 16:08:19 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:08:19 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:08:19 user devstack@n-api.service[61658]: Connection: close Apr 12 16:08:19 user devstack@n-api.service[61658]: Content-Length: 74 Apr 12 16:08:19 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:08:19 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:08:19 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:08:19 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtZTQTqxRy8JH2ztYRMFwtHlK4_DkQJIcL-yhNYeHG-WQ6xZvuBAGSDL9kmbAndCyhy5dHD4IXBNoPYoUxkIYnwl5fZpBMEBvoercid_4l9oOC2cM2boCag1Pw9732tGM2Wh6iNiwZxHliF_y7ssGyI7faVJw7nqyfL9wcRohFRNkyw Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Project-Id: 4e22ab21a50d45dba51ee1bd30028b9b Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Project-Name: tempest-VolumesAdminNegativeTest-437669774 Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Role: admin,member,reader Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Roles: admin,member,reader Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e22ab21a50d45dba51ee1bd30028b9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e22ab21a50d45dba51ee1bd30028b9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e22ab21a50d45dba51ee1bd30028b9b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Tenant: tempest-VolumesAdminNegativeTest-437669774 Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Tenant-Id: 4e22ab21a50d45dba51ee1bd30028b9b Apr 12 16:08:19 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-437669774 Apr 12 16:08:19 user devstack@n-api.service[61658]: X-User: tempest-VolumesAdminNegativeTest-437669774-project-admin Apr 12 16:08:19 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:08:19 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:08:19 user devstack@n-api.service[61658]: X-User-Id: 8d8e5338ebea4cb988170da84e5815e9 Apr 12 16:08:19 user devstack@n-api.service[61658]: X-User-Name: tempest-VolumesAdminNegativeTest-437669774-project-admin Apr 12 16:08:19 user devstack@n-api.service[61658]: Apr 12 16:08:19 user devstack@n-api.service[61658]: {"volumeAttachment": {"volumeId": "ce7eea7f-3b98-420f-8248-efa9422249ab"}} Apr 12 16:08:19 user devstack@n-api.service[61658]: method: > Apr 12 16:08:19 user devstack@n-api.service[61658]: exception: Volume 4d5b5ec0-468c-4861-a6ba-448372687ac2 could not be found. Apr 12 16:08:19 user devstack@n-api.service[61658]: action_args: {'server_id': '1496d262-ad85-4da5-be83-035c9806bd20', 'id': '4d5b5ec0-468c-4861-a6ba-448372687ac2', 'body': {'volumeAttachment': {'volumeId': 'ce7eea7f-3b98-420f-8248-efa9422249ab'}}} Apr 12 16:08:19 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4d5b5ec0-468c-4861-a6ba-448372687ac2 could not be found. (HTTP 404) (Request-ID: req-dd2d4868-a6b1-49cb-a019-061424304a3b) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4d5b5ec0-468c-4861-a6ba-448372687ac2 could not be found. Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4d5b5ec0-468c-4861-a6ba-448372687ac2 could not be found. Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4d5b5ec0-468c-4861-a6ba-448372687ac2 could not be found. Apr 12 16:08:19 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:08:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] Returning 404 to user: Volume 4d5b5ec0-468c-4861-a6ba-448372687ac2 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:08:19 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-03c14b86-c825-48dc-b13f-e4f54da950d0 tempest-VolumesAdminNegativeTest-437669774 tempest-VolumesAdminNegativeTest-437669774-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20/os-volume_attachments/4d5b5ec0-468c-4861-a6ba-448372687ac2" status: 404 len: 109 microversion: 2.1 time: 0.088755 Apr 12 16:08:19 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 170/504] 10.0.0.210 () {64 vars in 1510 bytes} [Wed Apr 12 16:08:19 2023] PUT /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20/os-volume_attachments/4d5b5ec0-468c-4861-a6ba-448372687ac2 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:08:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Creating event network-vif-unplugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:08:20 user devstack@n-api.service[61657]: DEBUG nova.compute.api [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61657) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:08:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-5bf49308-bc69-417c-84e5-1f5d25adaaf9 req-e67c48e5-fb62-4dd1-b086-9665f84026c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073222 Apr 12 16:08:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 169/505] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:08:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-81523f48-23bf-4a94-bb08-82eeada86ade tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20" status: 204 len: 0 microversion: 2.1 time: 0.223877 Apr 12 16:08:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 167/506] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:08:21 2023] DELETE /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:21 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-deb6d3f9-de48-4e46-9c69-88c079b64eba tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20" status: 200 len: 1499 microversion: 2.1 time: 0.171914 Apr 12 16:08:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 171/507] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:08:21 2023] GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20 => generated 1499 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:08:21 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-81759e86-5831-4bc7-8908-a3b804b3f892 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'create', calling method: .version_select at 0x7fdee77e4430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1145355827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP7vpIGcBykOJPr4ws0YtRwaxvjbKaTb5FQPV2F4kO1x9IPpUHiVmLwjEQx1FAApeD4swefMBOlg2jRi0dXdP+/5EMUIcDTR0iUGAbkMPwCdxqyQhFvFmsSM0dq+TS03mg=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:22 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-81759e86-5831-4bc7-8908-a3b804b3f892 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for project 236b9e609eb44071bc88971bff96931e. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:08:22 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-81759e86-5831-4bc7-8908-a3b804b3f892 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for user 16a68fa3490940ebaebc8d4ca5746f6e and project 236b9e609eb44071bc88971bff96931e. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:08:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496d262-ad85-4da5-be83-035c9806bd20", "name": "network-vif-unplugged", "status": "completed", "tag": "035ef219-1c48-4c0c-944d-686a6af767e5"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-81759e86-5831-4bc7-8908-a3b804b3f892 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.084242 Apr 12 16:08:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 170/508] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:08:21 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] Creating event network-vif-unplugged:035ef219-1c48-4c0c-944d-686a6af767e5 for instance 1496d262-ad85-4da5-be83-035c9806bd20 on user Apr 12 16:08:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-7d11a7be-21d0-4793-8742-02aa71d5f596 req-99f86048-9445-4b6b-b014-827a402019c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042068 Apr 12 16:08:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 168/509] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-305874148", "imageRef": "ca200f21-67f7-4581-9bfc-75465abff368", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1145355827", "networks": [{"uuid": "58f92787-e3b6-4fd3-bd75-7169f1a36651"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] validate_networks() for [('58f92787-e3b6-4fd3-bd75-7169f1a36651', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:08:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:08:22 user devstack@n-api.service[61657]: DEBUG nova.compute.api [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61657) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:08:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-7d15956e-c8a3-413a-9112-e2fc4d76c491 req-38ae6721-b522-459e-8601-65b92a58afbb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041199 Apr 12 16:08:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 171/510] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for project 236b9e609eb44071bc88971bff96931e. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for user 16a68fa3490940ebaebc8d4ca5746f6e and project 236b9e609eb44071bc88971bff96931e. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:08:22 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ca200f21-67f7-4581-9bfc-75465abff368',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:08:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b5bb173c-1ac4-478d-b96b-a6576db98029 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.721228 Apr 12 16:08:22 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 172/511] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:08:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:08:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6f2b6d60-fd48-4c9c-9fce-d3fe7695e486 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:22 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6f2b6d60-fd48-4c9c-9fce-d3fe7695e486 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:22 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-6f2b6d60-fd48-4c9c-9fce-d3fe7695e486 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6f2b6d60-fd48-4c9c-9fce-d3fe7695e486 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1252 microversion: 2.1 time: 0.077192 Apr 12 16:08:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 169/512] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:08:22 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1252 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:08:24 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1496d262-ad85-4da5-be83-035c9806bd20", "name": "network-vif-plugged", "status": "completed", "tag": "035ef219-1c48-4c0c-944d-686a6af767e5"}, {"server_uuid": "1496d262-ad85-4da5-be83-035c9806bd20", "name": "network-vif-deleted", "tag": "035ef219-1c48-4c0c-944d-686a6af767e5"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Creating event network-vif-plugged:035ef219-1c48-4c0c-944d-686a6af767e5 for instance 1496d262-ad85-4da5-be83-035c9806bd20 on user Apr 12 16:08:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] Creating event network-vif-deleted:035ef219-1c48-4c0c-944d-686a6af767e5 for instance 1496d262-ad85-4da5-be83-035c9806bd20 on user Apr 12 16:08:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3e05c762-df4a-41de-81d7-7e752b57b36e req-ae9418d8-fe88-4602-bb5c-1360ea22758c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029872 Apr 12 16:08:24 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 172/513] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] Creating event network-changed:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:08:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-8b2fe3eb-2e5e-4898-8ea2-2970dd530e39 req-23ee3321-ca83-4e56-9589-d11fd1d49c36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032748 Apr 12 16:08:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 173/514] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:08:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-plugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] Creating event network-vif-plugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:08:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-142c6609-ca5e-4bfb-acbe-542c647119a9 req-dff608ac-bffd-4005-b6cf-d64873f3ca81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045908 Apr 12 16:08:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 170/515] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:31 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:31 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-plugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] Creating event network-vif-plugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:08:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-56b28078-b45b-4327-b8f0-a562a59903e9 req-343c1608-0d92-43d9-8c33-fc646ff065d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031938 Apr 12 16:08:31 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 173/516] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:33 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:33 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:33 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}, {"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:08:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:08:33 user devstack@n-api.service[61658]: DEBUG nova.compute.api [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61658) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:08:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-25733b3f-ecfa-49f3-9370-5e57ae6661b8 req-41a216e4-bd68-424e-821e-006c1aabc5ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052597 Apr 12 16:08:33 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 174/517] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:38 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:38 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c3c0815f-6f64-48fe-8cde-60be6ac6ff90 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 200 len: 1705 microversion: 2.1 time: 0.164229 Apr 12 16:08:38 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 171/518] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:08:38 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 1705 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:42 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-794fb8a2-0c5f-4d00-a763-8d38ac269253 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 200 len: 1554 microversion: 2.1 time: 0.169202 Apr 12 16:08:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 174/519] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:08:42 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=23 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-8dd4bede-d647-4092-a7f0-18be73c4b477 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.099906 Apr 12 16:08:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 175/520] 10.0.0.210 () {64 vars in 1393 bytes} [Wed Apr 12 16:08:43 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-interface => generated 282 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:08:44 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:44 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:44 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=40,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:08:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] Creating event network-changed:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:08:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-9d05f631-74d4-4d91-a94c-b82ab199528a req-560c0a08-0bf4-4d43-8661-345261d19d17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051368 Apr 12 16:08:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 172/521] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9c4ea0fc-b2b7-4169-ae20-c9891a1233d7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/ips" status: 200 len: 109 microversion: 2.20 time: 0.036844 Apr 12 16:08:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 175/522] 10.0.0.210 () {64 vars in 1366 bytes} [Wed Apr 12 16:08:45 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/ips => generated 109 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:46 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-179b3233-d2c4-47af-95ed-08d81c8dd3be tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c" status: 200 len: 1691 microversion: 2.87 time: 0.186848 Apr 12 16:08:46 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 176/523] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:08:46 2023] GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:46 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lazy-loading 'flavor' on Instance uuid d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:08:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2ecb7127-1866-4c3a-a5d4-b48a6e72f02f tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/action" status: 202 len: 0 microversion: 2.20 time: 0.858290 Apr 12 16:08:47 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 173/524] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:08:46 2023] POST /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:47 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:08:47 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-07ff24cb-a1eb-4ef8-b50d-b30a2b42cee8 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 200 len: 1710 microversion: 2.20 time: 0.193262 Apr 12 16:08:47 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 176/525] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:08:47 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 1710 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:08:47 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-unplugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:47 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] Creating event network-vif-unplugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:08:47 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-0dfb10ab-fe9f-4608-b025-67aa4b614a4a req-f473111b-aa6c-4b42-b71f-f45eb6f2cc17 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059470 Apr 12 16:08:47 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 177/526] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-plugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:49 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] Creating event network-vif-plugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:08:49 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-e2741538-3927-4935-8e9c-464f0b9aac89 req-5bf7994c-53fa-4a4a-820b-c88cc1213c72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031928 Apr 12 16:08:49 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 174/527] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:08:51 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:08:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:08:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:08:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:08:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] Creating event network-changed:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:08:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-31113401-bb05-4a93-b838-e6770dbe5876 req-dd52073d-374a-4e43-834d-661bfb372fda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050888 Apr 12 16:08:52 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 177/528] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:08:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=8 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=12 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:02 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:02 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4881bec1-5756-4b86-afe1-5882b8fcff06 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab" status: 200 len: 1538 microversion: 2.1 time: 0.167051 Apr 12 16:09:02 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 178/529] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:02 2023] GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab => generated 1538 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=5 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-14fc419a-092d-4101-99dc-4e8b28afcbc8 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057388 Apr 12 16:09:04 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 175/530] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:09:04 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=8 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=18 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] Creating event network-changed:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:09:04 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-4d5d2a7d-3d7c-4021-a6f8-b28934386f1d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf" status: 204 len: 0 microversion: 2.1 time: 0.143767 Apr 12 16:09:04 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 178/531] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:09:04 2023] DELETE /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:09:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d865654c-c31f-4f80-8829-71a58f66ec75 req-35b25b4e-0ed1-4326-ae0b-418f802ddba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051903 Apr 12 16:09:04 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 179/532] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba5930f5-72be-4d2a-9ebd-47eae870a1e4"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:04 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-3b88fd01-47a1-4fe9-8fcf-6b4a78eefbfd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf" status: 200 len: 1668 microversion: 2.1 time: 0.210588 Apr 12 16:09:04 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 176/533] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:04 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf => generated 1668 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357dd90d-8c53-4193-ad64-edfa894116cf", "name": "network-vif-unplugged", "status": "completed", "tag": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] Creating event network-vif-unplugged:94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance 357dd90d-8c53-4193-ad64-edfa894116cf on user Apr 12 16:09:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-74ac71b4-d5c3-4bae-9e72-326e5d4bc098 req-192332d2-6cff-4bb2-b7cc-d405e1aeb951 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037728 Apr 12 16:09:04 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 180/534] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:04 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:04 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-30c49e5f-b86e-4e86-b0d0-f7d9a501e906 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "POST /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.471115 Apr 12 16:09:04 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 179/535] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:09:04 2023] POST /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments => generated 194 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:06 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-fc413e5d-2b1b-4c77-8931-4f212b7b6e76 req-59dbd63a-b731-46a3-a92b-f8717a055467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357dd90d-8c53-4193-ad64-edfa894116cf", "name": "network-vif-deleted", "tag": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-fc413e5d-2b1b-4c77-8931-4f212b7b6e76 req-59dbd63a-b731-46a3-a92b-f8717a055467 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-fc413e5d-2b1b-4c77-8931-4f212b7b6e76 req-59dbd63a-b731-46a3-a92b-f8717a055467 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-fc413e5d-2b1b-4c77-8931-4f212b7b6e76 req-59dbd63a-b731-46a3-a92b-f8717a055467 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-fc413e5d-2b1b-4c77-8931-4f212b7b6e76 req-59dbd63a-b731-46a3-a92b-f8717a055467 service nova] Creating event network-vif-deleted:94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance 357dd90d-8c53-4193-ad64-edfa894116cf on user Apr 12 16:09:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-fc413e5d-2b1b-4c77-8931-4f212b7b6e76 req-59dbd63a-b731-46a3-a92b-f8717a055467 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029812 Apr 12 16:09:06 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 177/536] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357dd90d-8c53-4193-ad64-edfa894116cf", "name": "network-vif-plugged", "status": "completed", "tag": "94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] Creating event network-vif-plugged:94db3bc9-9ecc-4f15-8105-4abb2ff9d1e5 for instance 357dd90d-8c53-4193-ad64-edfa894116cf on user Apr 12 16:09:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-673b81ee-e234-41c1-8d9d-3670b5858601 req-1a81046d-42c0-4be4-9c0b-8af0d3a61783 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032515 Apr 12 16:09:06 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 181/537] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:07 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5f022963-f2b6-410c-8ad9-d8445592c5ef tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1729 microversion: 2.1 time: 0.169064 Apr 12 16:09:07 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 180/538] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:07 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: 1496d262-ad85-4da5-be83-035c9806bd20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] HTTP exception thrown: Instance 1496d262-ad85-4da5-be83-035c9806bd20 could not be found. Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Request method failure captured: Apr 12 16:09:12 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20 HTTP/1.1 Apr 12 16:09:12 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:09:12 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:09:12 user devstack@n-api.service[61659]: Connection: close Apr 12 16:09:12 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:09:12 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:09:12 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:09:12 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:09:12 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtZI0NXiFEpUbc6i6JLbBsP5ksx-VfvcIDssQtqqaKv5fCzfZ3-NdU4zIIMo-qfY5UwNwMJh-_Rpoy8554I1UIZLCZlRj74Nj5KwkY7SBapE4-YUR1fevxFzrIC1pkgE6n3O2WUrTQO452mMAoTBA17cg03esuX-61wh-uNzbkUYKuk Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Project-Id: 76f559719f5f43c3a47a0aaf1e699193 Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesAdminNegativeTest-716771515 Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76f559719f5f43c3a47a0aaf1e699193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76f559719f5f43c3a47a0aaf1e699193"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76f559719f5f43c3a47a0aaf1e699193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesAdminNegativeTest-716771515 Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Tenant-Id: 76f559719f5f43c3a47a0aaf1e699193 Apr 12 16:09:12 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-716771515 Apr 12 16:09:12 user devstack@n-api.service[61659]: X-User: tempest-VolumesAdminNegativeTest-716771515-project-member Apr 12 16:09:12 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:09:12 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:09:12 user devstack@n-api.service[61659]: X-User-Id: 2b65791f14d34508b8a9a0849a9bf89e Apr 12 16:09:12 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesAdminNegativeTest-716771515-project-member Apr 12 16:09:12 user devstack@n-api.service[61659]: method: > Apr 12 16:09:12 user devstack@n-api.service[61659]: exception: Instance 1496d262-ad85-4da5-be83-035c9806bd20 could not be found. Apr 12 16:09:12 user devstack@n-api.service[61659]: action_args: {'id': '1496d262-ad85-4da5-be83-035c9806bd20'} Apr 12 16:09:12 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1496d262-ad85-4da5-be83-035c9806bd20 could not be found. Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1496d262-ad85-4da5-be83-035c9806bd20 could not be found. Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1496d262-ad85-4da5-be83-035c9806bd20 could not be found. Apr 12 16:09:12 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Returning 404 to user: Instance 1496d262-ad85-4da5-be83-035c9806bd20 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:09:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a3ec6644-cc7a-466c-8cbb-a21233c19aa2 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20" status: 404 len: 111 microversion: 2.1 time: 0.180676 Apr 12 16:09:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 178/539] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:11 2023] GET /compute/v2.1/servers/1496d262-ad85-4da5-be83-035c9806bd20 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:12 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'services' on Instance uuid 78b6940a-f97a-4535-8973-3c2a5befbbab {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:09:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e582b4a5-21dc-406b-ac1c-dd11a518d735 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments/ba5930f5-72be-4d2a-9ebd-47eae870a1e4" status: 202 len: 0 microversion: 2.1 time: 0.188923 Apr 12 16:09:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 182/540] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:09:12 2023] DELETE /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments/ba5930f5-72be-4d2a-9ebd-47eae870a1e4 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ae0306da-09cd-4715-9c6e-002b1b793fb9 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061275 Apr 12 16:09:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 181/541] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:09:12 2023] GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:13 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c34a9711-32cd-40e8-8f75-bc6573bae2d7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1535 microversion: 2.1 time: 0.240211 Apr 12 16:09:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 179/542] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:12 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1535 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:14 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:09:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c0522bc1-90fb-4856-890c-1c29c59d1c7e tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" status: 204 len: 0 microversion: 2.1 time: 0.155307 Apr 12 16:09:14 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 183/543] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:09:14 2023] DELETE /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:14 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b65791f14d34508b8a9a0849a9bf89e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76f559719f5f43c3a47a0aaf1e699193', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-30889e7f-0cc7-4914-91a6-7f04d896b742 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" status: 200 len: 1664 microversion: 2.1 time: 0.199042 Apr 12 16:09:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 182/544] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:14 2023] GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => generated 1664 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:09:14 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e", "name": "network-vif-unplugged", "status": "completed", "tag": "20f49d80-ccad-450e-baed-417505f17cc2"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] Creating event network-vif-unplugged:20f49d80-ccad-450e-baed-417505f17cc2 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e on user Apr 12 16:09:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-639c7bed-e6e9-4138-8eda-7ff47841cb5c req-66e2e756-66a7-446e-9112-95f81e0f48cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038447 Apr 12 16:09:14 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 180/545] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-e4352754-40a6-4d80-a9bc-4b83f8009b8c req-74a72022-593d-458d-806f-636251ceebf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e", "name": "network-vif-deleted", "tag": "20f49d80-ccad-450e-baed-417505f17cc2"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e4352754-40a6-4d80-a9bc-4b83f8009b8c req-74a72022-593d-458d-806f-636251ceebf6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e4352754-40a6-4d80-a9bc-4b83f8009b8c req-74a72022-593d-458d-806f-636251ceebf6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e4352754-40a6-4d80-a9bc-4b83f8009b8c req-74a72022-593d-458d-806f-636251ceebf6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e4352754-40a6-4d80-a9bc-4b83f8009b8c req-74a72022-593d-458d-806f-636251ceebf6 service nova] Creating event network-vif-deleted:20f49d80-ccad-450e-baed-417505f17cc2 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e on user Apr 12 16:09:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-e4352754-40a6-4d80-a9bc-4b83f8009b8c req-74a72022-593d-458d-806f-636251ceebf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032902 Apr 12 16:09:16 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 184/546] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e", "name": "network-vif-plugged", "status": "completed", "tag": "20f49d80-ccad-450e-baed-417505f17cc2"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] Creating event network-vif-plugged:20f49d80-ccad-450e-baed-417505f17cc2 for instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e on user Apr 12 16:09:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-50a99a0b-e2a2-4a95-8ead-d801396c877c req-32577c26-ae3e-4eda-8853-87f6b0f1dee3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037230 Apr 12 16:09:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 183/547] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=12 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=24 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:37 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-801608c9-dc56-4cc4-8e82-03e0335255b0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 200 len: 1651 microversion: 2.20 time: 0.161923 Apr 12 16:09:37 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 181/548] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:09:37 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 1651 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2c6221b9-7779-45df-aa9f-743ac73533cc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/action" status: 202 len: 0 microversion: 2.1 time: 0.193263 Apr 12 16:09:38 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 185/549] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:09:38 2023] POST /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:38 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:39 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-735ceea2-cefb-4803-8f7b-ea308e181ffb tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.147864 Apr 12 16:09:39 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 184/550] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:09:38 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-interface => generated 283 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:39 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-unplugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] Creating event network-vif-unplugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:09:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-8a0e6063-d662-47e1-b3b8-7e73e48a0f0d req-5f49d6af-8d06-4411-b1b0-d088ba1662e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038783 Apr 12 16:09:39 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 182/551] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:41 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}, {"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}, {"name": "network-changed", "server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}, {"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Creating event network-changed:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:09:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:09:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Creating event network-changed:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:09:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:09:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-62937e61-5951-4163-83ff-3ec09069f031 req-59fd7c6f-0e1b-4e73-b5fa-14c509110b9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 688 microversion: 2.1 time: 0.031851 Apr 12 16:09:41 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 186/552] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:41 2023] POST /compute/v2.1/os-server-external-events => generated 688 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-dad99549-41fd-4730-b4e2-832d0c3e9818 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.228822 Apr 12 16:09:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 185/553] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:09:42 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-interface => generated 282 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f27a002-8dfc-4d90-aa35-ba16586d4366"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}, {"name": "network-changed", "server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:09:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] Creating event network-changed:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:09:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-9e3ddd1a-5639-4896-af9b-feb5498aa3c6 req-370e2cba-f552-42b4-bff9-caf946751da2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.042493 Apr 12 16:09:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 187/554] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:43 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8cc6bed4-af6a-43a0-8ada-ffbed4998ace tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304426 Apr 12 16:09:44 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 183/555] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:09:43 2023] POST /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-537854581"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:47 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3d9fb512-3f61-4529-9699-85c1ab0a8990 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c/action" status: 202 len: 52 microversion: 2.87 time: 0.849722 Apr 12 16:09:47 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 186/556] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:09:46 2023] POST /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c/action => generated 52 bytes in 851 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:51 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'flavor' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:09:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-897b35cd-b9cb-449f-bdef-8c39a0a9e6a3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/action" status: 200 len: 32 microversion: 2.1 time: 0.221758 Apr 12 16:09:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 188/557] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:09:51 2023] POST /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:52 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f0f1ef09-afe6-47ca-815f-180e8901230e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 200 len: 1725 microversion: 2.1 time: 0.166305 Apr 12 16:09:52 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 184/558] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:51 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:09:52 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-unplugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:52 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] Creating event network-vif-unplugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:09:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-d69b95ad-a5d4-4cca-be94-4f0e2e4225e1 req-15931680-0957-424a-8152-ca8013774a4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094669 Apr 12 16:09:52 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 187/559] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:53 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:53 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-80fb6587-def6-4cac-971c-831067a0246b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c" status: 200 len: 1691 microversion: 2.87 time: 0.163659 Apr 12 16:09:53 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 189/560] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:09:53 2023] GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:09:54 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf HTTP/1.1 Apr 12 16:09:54 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:09:54 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:09:54 user devstack@n-api.service[61659]: Connection: close Apr 12 16:09:54 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:09:54 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:09:54 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:09:54 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:09:54 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:09:54 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:09:54 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:09:54 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:09:54 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:09:54 user devstack@n-api.service[61659]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:09:54 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:09:54 user devstack@n-api.service[61659]: method: > Apr 12 16:09:54 user devstack@n-api.service[61659]: exception: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:09:54 user devstack@n-api.service[61659]: action_args: {'id': '357dd90d-8c53-4193-ad64-edfa894116cf'} Apr 12 16:09:54 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:09:54 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:09:54 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:09:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-50af3755-232f-4d6e-9845-2dd4aade9ab5 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf" status: 404 len: 111 microversion: 2.1 time: 0.170183 Apr 12 16:09:54 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 185/561] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:54 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:09:54 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-557e677b-b8a0-4798-a577-a7de4e19342b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '.version_select at 0x7fdee77e70a0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:54 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:54 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-557e677b-b8a0-4798-a577-a7de4e19342b tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-724661013" status: 202 len: 0 microversion: 2.1 time: 0.029712 Apr 12 16:09:54 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 188/562] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 16:09:54 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-724661013 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:09:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:09:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-91900251-ea74-41df-b5f9-53989a99975b req-c0cbb543-6bab-4cb8-8cd1-25b4987afb56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053142 Apr 12 16:09:54 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 190/563] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-921d5553-de4d-4e66-b545-a9e3ea0b0759 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: .version_select at 0x7fdee78e5bd0>, body: {"keypair": {"name": "tempest-keypair-1846852248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMV14aR/BI8YAjSCONdULZvRqXfIdT8RapVzPcFF9r21388G6jXQ3sF9h/frRtTRkPlFihOSvv8T7SIRbtzU0tJmwXvgpK22Hpu/EyKFqKnRb3Q7irg6PNvPxtJ9D47+Bw=="}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:55 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-921d5553-de4d-4e66-b545-a9e3ea0b0759 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:09:55 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-921d5553-de4d-4e66-b545-a9e3ea0b0759 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'key_pairs'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:09:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-921d5553-de4d-4e66-b545-a9e3ea0b0759 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054250 Apr 12 16:09:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 186/564] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:09:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:56 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}, {"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:09:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:09:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-bea43efb-83e1-43a1-b9ac-5cbf536dbc64 req-ea0ce83d-48e4-4c72-b5e3-ccadba47ddc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028576 Apr 12 16:09:56 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 189/565] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:09:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-180716396", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "e71b9966-9a95-4f66-b3b1-36b05d05853c"}], "security_groups": [{"name": "tempest-securitygroup--27971433"}], "key_name": "tempest-keypair-1846852248", "user_data": "}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] validate_networks() for [('e71b9966-9a95-4f66-b3b1-36b05d05853c', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Getting quotas for user 5a514f6d877a4ab0bec597fee13ce9db and project 28d940eae5394293b87cfced45911ab4. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:09:57 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:09:57 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-bfe8f037-e253-49fc-9142-99421ca2e161 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.764933 Apr 12 16:09:57 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 191/566] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:09:57 2023] POST /compute/v2.1/servers => generated 398 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:09:57 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-49bd4ed6-7052-4c62-ba7e-70fb46abd6e2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:09:57 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-49bd4ed6-7052-4c62-ba7e-70fb46abd6e2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:09:57 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-49bd4ed6-7052-4c62-ba7e-70fb46abd6e2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:09:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-49bd4ed6-7052-4c62-ba7e-70fb46abd6e2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f" status: 200 len: 1235 microversion: 2.1 time: 0.063839 Apr 12 16:09:57 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 187/567] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:09:57 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f => generated 1235 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2511c44-8365-4e8c-9814-172547111b9f", "tag": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] Creating event network-changed:3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance f2511c44-8365-4e8c-9814-172547111b9f on user Apr 12 16:10:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a7050b36-42f7-4429-93f0-6efbd00b4fb7 req-12d1e825-a4ab-4aeb-aa37-acca82718b89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036340 Apr 12 16:10:00 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 190/568] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:02 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:02 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2511c44-8365-4e8c-9814-172547111b9f", "name": "network-vif-plugged", "status": "completed", "tag": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-3f7565a0-5f09-4e78-9dfc-5661de11441f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082729 Apr 12 16:10:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 192/569] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:10:02 2023] GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:10:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] Creating event network-vif-plugged:3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance f2511c44-8365-4e8c-9814-172547111b9f on user Apr 12 16:10:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-b2230a81-1fd8-4358-b775-e34115d90593 req-49e794be-b9af-4500-afc8-701f28b52c5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076232 Apr 12 16:10:03 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 188/570] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] [instance: ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:04 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] HTTP exception thrown: Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e could not be found. Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Request method failure captured: Apr 12 16:10:04 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e HTTP/1.1 Apr 12 16:10:04 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:10:04 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:10:04 user devstack@n-api.service[61657]: Connection: close Apr 12 16:10:04 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:10:04 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:10:04 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:10:04 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:10:04 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtZI0NXiFEpUbc6i6JLbBsP5ksx-VfvcIDssQtqqaKv5fCzfZ3-NdU4zIIMo-qfY5UwNwMJh-_Rpoy8554I1UIZLCZlRj74Nj5KwkY7SBapE4-YUR1fevxFzrIC1pkgE6n3O2WUrTQO452mMAoTBA17cg03esuX-61wh-uNzbkUYKuk Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Project-Id: 76f559719f5f43c3a47a0aaf1e699193 Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Project-Name: tempest-VolumesAdminNegativeTest-716771515 Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/76f559719f5f43c3a47a0aaf1e699193"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76f559719f5f43c3a47a0aaf1e699193"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/76f559719f5f43c3a47a0aaf1e699193"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Tenant: tempest-VolumesAdminNegativeTest-716771515 Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Tenant-Id: 76f559719f5f43c3a47a0aaf1e699193 Apr 12 16:10:04 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-716771515 Apr 12 16:10:04 user devstack@n-api.service[61657]: X-User: tempest-VolumesAdminNegativeTest-716771515-project-member Apr 12 16:10:04 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:10:04 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:10:04 user devstack@n-api.service[61657]: X-User-Id: 2b65791f14d34508b8a9a0849a9bf89e Apr 12 16:10:04 user devstack@n-api.service[61657]: X-User-Name: tempest-VolumesAdminNegativeTest-716771515-project-member Apr 12 16:10:04 user devstack@n-api.service[61657]: method: > Apr 12 16:10:04 user devstack@n-api.service[61657]: exception: Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e could not be found. Apr 12 16:10:04 user devstack@n-api.service[61657]: action_args: {'id': 'ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e'} Apr 12 16:10:04 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e could not be found. Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e could not be found. Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e could not be found. Apr 12 16:10:04 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:10:04 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Returning 404 to user: Instance ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:10:04 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-49ad4a88-db1b-4638-b6d8-a7a8b43a0a70 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e" status: 404 len: 111 microversion: 2.1 time: 0.030903 Apr 12 16:10:04 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 191/571] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:04 2023] GET /compute/v2.1/servers/ad1e70a2-f671-4b6c-8bb1-b549d59f2b2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:10:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1eb004d8-1038-4de7-86ca-918d3f33d755 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] Calling method '.version_select at 0x7fdee77025f0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1eb004d8-1038-4de7-86ca-918d3f33d755 tempest-VolumesAdminNegativeTest-716771515 tempest-VolumesAdminNegativeTest-716771515-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119173920" status: 202 len: 0 microversion: 2.1 time: 0.025687 Apr 12 16:10:04 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 193/572] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 16:10:04 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2119173920 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:10:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2511c44-8365-4e8c-9814-172547111b9f", "name": "network-vif-plugged", "status": "completed", "tag": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] Creating event network-vif-plugged:3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance f2511c44-8365-4e8c-9814-172547111b9f on user Apr 12 16:10:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-7a1c299f-af10-4df8-90f7-d326362999f8 req-5dceb2a4-33e0-4573-9bae-c4d8ced2527b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036132 Apr 12 16:10:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 189/573] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-677236483"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-8d7875a4-26ce-4bd2-b2f6-541189dbd107 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "POST /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/action" status: 202 len: 0 microversion: 2.1 time: 1.229411 Apr 12 16:10:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 192/574] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:10:05 2023] POST /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/action => generated 0 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5d57ee95-b468-40fc-a118-3ff198e91ba7 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/action" status: 202 len: 0 microversion: 2.1 time: 0.219711 Apr 12 16:10:07 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 194/575] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:10:07 2023] POST /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:07 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:08 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-11dbabe0-dd66-4ced-b2f0-43e4b3cfb2a0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1728 microversion: 2.1 time: 0.442501 Apr 12 16:10:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 190/576] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:07 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1728 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:09 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:09 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:09 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Creating event network-vif-unplugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:10:09 user devstack@n-api.service[61657]: DEBUG nova.compute.api [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61657) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:10:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-dd6708e8-c4ef-49a3-b241-7fc5ba53da22 req-8687a4c1-4f46-442c-a09c-f1ddd3b1eed2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074325 Apr 12 16:10:09 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 193/577] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:10:11 user devstack@n-api.service[61658]: DEBUG nova.compute.api [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61658) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:10:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-76a5ef09-9326-459e-9c2b-e0af3a89734c req-8fd21b7f-2257-4b36-992d-065578491ca0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059951 Apr 12 16:10:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 195/578] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:11 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lazy-loading 'services' on Instance uuid 6caa4977-8333-4171-8825-2c3bfb52f80b {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:10:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a9452c71-7de1-4881-9fcb-307f28ce3dae tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments/7cc863d9-b797-4b5b-b8ce-30ebe55b9519" status: 202 len: 0 microversion: 2.1 time: 0.271685 Apr 12 16:10:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 191/579] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:10:11 2023] DELETE /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments/7cc863d9-b797-4b5b-b8ce-30ebe55b9519 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-b887c121-1a8d-4d92-a113-389ba406d0bc tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065009 Apr 12 16:10:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 194/580] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:10:12 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:13 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f063e621-37f3-4b9a-bdb8-3e8a82223f98 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1535 microversion: 2.1 time: 0.206972 Apr 12 16:10:13 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 196/581] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:13 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1535 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Searching by: {'deleted': False, 'project_id': '236b9e609eb44071bc88971bff96931e'} {{(pid=61659) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:13 user devstack@n-api.service[61659]: DEBUG nova.compute.multi_cell_list [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61659) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 16:10:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c7d0e50f-d5a4-4551-bf2f-75be6583845d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.252871 Apr 12 16:10:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 192/582] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 16:10:13 2023] GET /compute/v2.1/servers => generated 340 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:13 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-8c7a2c1a-9cca-4955-aba7-a5920a338869 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1535 microversion: 2.1 time: 0.184066 Apr 12 16:10:13 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 195/583] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:13 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1535 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:15 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-996381593", "imageRef": "6c9c5a01-7bd3-4f1f-b219-5ed4224fd354", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1321754823", "security_groups": [{"name": "tempest-secgroup-smoke-506862283"}], "networks": [{"uuid": "1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c961fcc-0ff0-4275-9163-406662b265f8"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:15 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] validate_networks() for [('1c560b5e-bb6f-42eb-b9b2-6b3f2eaed0f8', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:10:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-3889dbea-d5b4-4da4-882a-1dc2a8c3770b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309516 Apr 12 16:10:16 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 193/584] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:10:15 2023] POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting quotas for project a77372a5e83c4fc882b0a0b0eea46f06. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Getting quotas for user 5e0ffc0972674609b17fe2780751dfc5 and project a77372a5e83c4fc882b0a0b0eea46f06. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:10:16 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6c9c5a01-7bd3-4f1f-b219-5ed4224fd354',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:10:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1cd91069-e0aa-44a0-9d09-c7f40cd883ab tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.711533 Apr 12 16:10:16 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 197/585] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:10:15 2023] POST /compute/v2.1/servers => generated 403 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:10:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-040abd4e-f188-476e-ae8b-f71ae7d92609 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:16 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-040abd4e-f188-476e-ae8b-f71ae7d92609 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:16 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-040abd4e-f188-476e-ae8b-f71ae7d92609 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-040abd4e-f188-476e-ae8b-f71ae7d92609 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a" status: 200 len: 1236 microversion: 2.1 time: 0.074025 Apr 12 16:10:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 196/586] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:16 2023] GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:10:22 user devstack@n-api.service[61659]: DEBUG nova.compute.api [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61659) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:10:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-44ea0049-b1e1-4103-bbe5-f263fa5a7ba4 req-b57aa18b-0a84-4b2a-92f4-472eb6e3638e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071229 Apr 12 16:10:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 194/587] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] Creating event network-changed:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:10:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-dce6d134-9408-487f-b8a2-8683a76d8504 req-15e8fbdd-1dd5-4455-9ff7-415b841f7ea2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038222 Apr 12 16:10:22 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 198/588] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:24 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:24 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=15 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:10:24 user devstack@n-api.service[61657]: DEBUG nova.compute.api [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61657) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:10:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-ee635625-5346-4b53-adda-8fb1c2b54ac1 req-e1893802-697d-47ab-aaa5-e68d8b157d9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056859 Apr 12 16:10:24 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 197/589] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:26 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:26 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "name": "network-vif-plugged", "status": "completed", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] Creating event network-vif-plugged:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:10:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-f9506aa5-cbf1-4d2a-8304-d7f9e39d93da req-b90ce637-10c9-4331-87b3-d1ffd9298b80 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064101 Apr 12 16:10:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 199/590] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:26 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-bfbdfc9d-9921-4b1f-a468-055baa739e89 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'create', calling method: .version_select at 0x7fdee76e93f0>, body: {"keypair": {"name": "tempest-keypair-1295229303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFG81tsYAjuSLmCBJX5Oy53u6RydBq93WUwqVYUMtou9Wro9aHLYlkjtVGeLCCkr0S7Y24E90tPBrxAk1jNQ+AbkSKQBVRm7+VgL4Rx9C6hm1o9gCqXWuOVCyPnDpz3Eig=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-00360f30-46bc-49e0-b5db-4d25a4b6543c tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1581 microversion: 2.1 time: 0.261832 Apr 12 16:10:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 195/591] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:26 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1581 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:26 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-bfbdfc9d-9921-4b1f-a468-055baa739e89 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:10:26 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-bfbdfc9d-9921-4b1f-a468-055baa739e89 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for user 2996f6997bb14fc3aec9c3736cc65b8a and project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:10:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-bfbdfc9d-9921-4b1f-a468-055baa739e89 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.306356 Apr 12 16:10:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 198/592] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:10:26 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:28 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "name": "network-vif-plugged", "status": "completed", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] Creating event network-vif-plugged:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:10:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-45bd3ba3-4907-40a9-838e-32c58a6a2d05 req-140f0621-b45d-427e-a4f6-61ce01a67da1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042037 Apr 12 16:10:28 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 200/593] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:10:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1671411109", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26"}], "security_groups": [{"name": "tempest-securitygroup--1678981025"}], "key_name": "tempest-keypair-1295229303", "user_data": "}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] validate_networks() for [('1ef428ff-90e5-4abd-93d0-b7c2c581cb26', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:10:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] Creating event network-changed:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:10:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-aee17291-0180-4abc-8e81-35570982c992 req-400b051d-99ed-4779-981d-cc5ddb5a7621 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038525 Apr 12 16:10:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 199/594] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for user 2996f6997bb14fc3aec9c3736cc65b8a and project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:10:29 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:10:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-14a0d391-29f5-4dcf-8400-67fd399d7e1f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.820489 Apr 12 16:10:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 196/595] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:10:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:10:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-0aa25d1b-1f83-48aa-91c3-cebae246926c tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:29 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-0aa25d1b-1f83-48aa-91c3-cebae246926c tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:29 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-0aa25d1b-1f83-48aa-91c3-cebae246926c tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-0aa25d1b-1f83-48aa-91c3-cebae246926c tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1232 microversion: 2.1 time: 0.113627 Apr 12 16:10:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 201/596] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:29 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1232 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1597117228"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:31 user devstack@n-api.service[61657]: INFO nova.network.security_group_api [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Adding security group 7acd4a82-ecaa-49ef-a58f-ef93b0c196f4 to port a8837af3-03f7-4b3d-8a2a-746f2d8038ad Apr 12 16:10:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a9ed7dd3-86db-4214-9aea-f30cca53a5fe tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/action" status: 202 len: 0 microversion: 2.1 time: 1.113324 Apr 12 16:10:32 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 200/597] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:10:31 2023] POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:32 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] Creating event network-changed:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:10:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-30bb45e3-aee3-4458-9843-b6bfc5f7c7d8 req-e1d55deb-6bd2-41be-b1b3-c43b5d13cd46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 Apr 12 16:10:32 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 202/598] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:32 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-e5bf9e3b-1a9f-4e8c-ade2-8c07f47f5674 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1747 microversion: 2.1 time: 0.193100 Apr 12 16:10:32 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 197/599] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:32 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1747 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] Creating event network-changed:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:10:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-f13c9384-5e32-4414-885d-fd45587668be req-36e6d991-6df6-4372-80a0-4ecb8849afa7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030131 Apr 12 16:10:34 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 201/600] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-312b101d-47ea-4dd8-ab0c-ce03e37780bf tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/action" status: 202 len: 0 microversion: 2.1 time: 0.166267 Apr 12 16:10:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 203/601] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:10:35 2023] POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:35 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:35 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:10:35 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e20573b6-cfcd-48a7-a125-38859805dffc req-9bd3d1fb-8b68-4e98-85d5-35defeb2fbad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060885 Apr 12 16:10:35 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 202/602] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:35 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:35 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-df302b21-30b3-46d9-966a-233306acd2c6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1749 microversion: 2.1 time: 0.359592 Apr 12 16:10:35 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 198/603] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:35 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1749 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:37 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}, {"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-unplugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}, {"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-plugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:37 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:10:37 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Creating event network-vif-unplugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:10:37 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] Creating event network-vif-plugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:10:37 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-c3868d41-f57a-4e9b-bc7b-84f7a5c721d2 req-104cc2ca-b427-48d2-8438-9ae4fac0c106 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.047555 Apr 12 16:10:37 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 204/604] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:37 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5466e01-555f-45ea-90ea-7802f8f4a679"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:38 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-15dd2669-917d-4530-a910-94c34aadc2b7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.516019 Apr 12 16:10:38 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 203/605] 10.0.0.210 () {66 vars in 1441 bytes} [Wed Apr 12 16:10:37 2023] POST /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-volume_attachments => generated 188 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:38 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:38 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1351738b-370a-4861-aca4-52f6f0787120 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-volume_attachments/c5466e01-555f-45ea-90ea-7802f8f4a679" status: 202 len: 0 microversion: 2.20 time: 0.331980 Apr 12 16:10:38 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 199/606] 10.0.0.210 () {64 vars in 1534 bytes} [Wed Apr 12 16:10:38 2023] DELETE /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-volume_attachments/c5466e01-555f-45ea-90ea-7802f8f4a679 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:38 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61658) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 12 16:10:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6ddf74af-68b6-4a88-bcea-396d74baf9e0 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/action" status: 202 len: 0 microversion: 2.20 time: 0.141464 Apr 12 16:10:39 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 205/607] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:10:38 2023] POST /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:39 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:39 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-44465e3c-5d88-4389-9f36-839b69b2b503 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 200 len: 1659 microversion: 2.20 time: 0.190705 Apr 12 16:10:39 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 204/608] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:10:39 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 1659 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:10:41 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:41 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:41 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-plugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:41 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:41 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] Creating event network-vif-plugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:10:41 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-c31de41e-1447-4c98-8d38-2c5ae41cc413 req-42ef0863-b29e-4b6a-adac-999426a33962 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044628 Apr 12 16:10:41 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 200/609] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:42 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:42 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] Creating event network-changed:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:10:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-01b34c89-47b8-44d6-936a-a3a02134af1c req-88be46c7-f1ba-4b8c-934e-93da3ccb3b45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044244 Apr 12 16:10:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 206/610] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:42 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-8879dd05-a73f-4995-ba2c-5cd33cce0a18 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 200 len: 1705 microversion: 2.1 time: 0.378286 Apr 12 16:10:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 205/611] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:42 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 1705 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-plugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] Creating event network-vif-plugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:10:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-21730c62-1b65-4517-af42-01bacfc209e8 req-ac840b1e-0920-4170-81b2-aaf19d48fbe3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028593 Apr 12 16:10:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 201/612] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:10:48 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:48 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1cd49b69-f0f9-400b-b1ca-d9e8e8d2bdc0 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f" status: 200 len: 1542 microversion: 2.1 time: 0.150355 Apr 12 16:10:48 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 207/613] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:48 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f => generated 1542 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:10:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-plugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] Creating event network-vif-plugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:10:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-741ac562-e5e7-4411-b374-886207d33650 req-9d3965d5-d3e9-45cf-9cc7-d462a1224e8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143897 Apr 12 16:10:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 206/614] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:51 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-plugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] Creating event network-vif-plugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:10:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-af696299-1076-49a0-bff3-cf9b6c0587d7 req-844f0135-c6f3-4604-8037-2bf41b880e25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029280 Apr 12 16:10:51 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 202/615] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1308581862", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "destination_type": "volume"}], "networks": [{"uuid": "b36306e0-04c5-4b1b-8022-05ff121c4e43"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] validate_networks() for [('b36306e0-04c5-4b1b-8022-05ff121c4e43', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Getting quotas for user 73f9fa5bc22a4824b3cdcb8cf7bb380c and project 9210f81232304e179d3e09914a492442. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:10:54 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:10:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-8a140bfb-f600-452b-8b01-6480f945f20b tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.648728 Apr 12 16:10:54 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 208/616] 10.0.0.210 () {66 vars in 1265 bytes} [Wed Apr 12 16:10:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 12 16:10:54 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-bf9f64ff-ca57-4524-b278-113da7096319 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:54 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-bf9f64ff-ca57-4524-b278-113da7096319 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:54 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-bf9f64ff-ca57-4524-b278-113da7096319 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:54 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-bf9f64ff-ca57-4524-b278-113da7096319 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:54 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-bf9f64ff-ca57-4524-b278-113da7096319 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:54 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-bf9f64ff-ca57-4524-b278-113da7096319 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 200 len: 1395 microversion: 2.87 time: 0.085337 Apr 12 16:10:54 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 207/617] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:10:54 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 1395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:10:57 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:10:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] Creating event network-changed:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:10:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-193b7f93-49e1-4130-a557-a1e72507b058 req-25238a38-e933-4310-b806-f3b7b63380bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034343 Apr 12 16:10:57 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 203/618] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:10:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:10:58 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:10:58 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2eee84f3-8331-4efe-9568-1d65037b68bf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1721 microversion: 2.1 time: 0.297336 Apr 12 16:10:58 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 209/619] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:10:58 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1721 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-273260da-5e03-431c-a409-146028631600 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054405 Apr 12 16:11:02 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 208/620] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:11:02 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:11:04 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8ab6e390-9242-4889-8109-df250ffd5bfa tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '.version_select at 0x7fdee751f760>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:04 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8ab6e390-9242-4889-8109-df250ffd5bfa tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4" status: 204 len: 0 microversion: 2.1 time: 0.313764 Apr 12 16:11:04 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 204/621] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:04 2023] DELETE /compute/v2.1/images/7cf43834-8139-44fb-a821-3bb62ca931b4 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:04 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:11:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-431119d3-1cb2-4ccc-8dc9-d707251ee375 tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 204 len: 0 microversion: 2.1 time: 0.295921 Apr 12 16:11:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 210/622] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:11:04 2023] DELETE /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:05 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f76e286bd75a4cbaad7a7b735014f3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3deffbb4769b4985b038b4adcd82b018', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-798ee975-0d07-46ed-b4d1-9b6b2985ca8f tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 200 len: 1679 microversion: 2.1 time: 0.190032 Apr 12 16:11:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 209/623] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:05 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:11:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-unplugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] Creating event network-vif-unplugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:11:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-a7c92fad-1bbb-4e07-97bf-41d8009b57d6 req-e875b023-14db-4bd6-bae9-ce40a9dd8079 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102577 Apr 12 16:11:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 205/624] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:06 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-656a6b9a-759d-46ca-9a05-968321f326f7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a" status: 200 len: 1537 microversion: 2.1 time: 0.212660 Apr 12 16:11:06 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 211/625] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:06 2023] GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a => generated 1537 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:11:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-deleted", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] Creating event network-vif-deleted:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:11:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-15b53b85-81ca-4c28-886b-1c7b23ed33db req-dda8debb-3d6d-496a-a765-5d2272427d6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039156 Apr 12 16:11:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 210/626] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6caa4977-8333-4171-8825-2c3bfb52f80b", "name": "network-vif-plugged", "status": "completed", "tag": "c42ace22-d91b-4e4b-909e-19aaa428515a"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] Creating event network-vif-plugged:c42ace22-d91b-4e4b-909e-19aaa428515a for instance 6caa4977-8333-4171-8825-2c3bfb52f80b on user Apr 12 16:11:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-35059430-15b5-45da-ab79-1cd748426db4 req-836ba7e7-4a98-4de6-80f7-ee34d5c4789a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039531 Apr 12 16:11:07 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 206/627] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:09 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:11:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-02478d16-2237-47d1-b9cf-5e99a17c6144 req-01e9574a-11a7-42f2-ba45-2c4d80fd145b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033008 Apr 12 16:11:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 212/628] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:11 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:11 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=18 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:11:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3e217fb3-0044-4a58-bbae-354463b99f17 req-ea24bf76-5579-4058-883c-36bf5a4f9420 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033632 Apr 12 16:11:11 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 211/629] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=13 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=26,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:20 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7634c58d-c58b-42ee-9aee-1f088f122e9e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1538 microversion: 2.1 time: 0.163882 Apr 12 16:11:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 207/630] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:19 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1538 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:25 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:25 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-ec0d240b-a8bb-43d3-8da7-631704256110 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1747 microversion: 2.1 time: 0.177306 Apr 12 16:11:25 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 213/631] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:25 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1747 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=16 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:29 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5151c4dc-f88e-4e9e-94df-0d56d6e4aaa9 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 200 len: 1704 microversion: 2.20 time: 0.153181 Apr 12 16:11:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 212/632] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:11:29 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 1704 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] HTTP exception thrown: Cannot 'detach_volume' instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 while it is in vm_state rescued Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Request method failure captured: Apr 12 16:11:42 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments/1f27a002-8dfc-4d90-aa35-ba16586d4366 HTTP/1.1 Apr 12 16:11:42 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:11:42 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:11:42 user devstack@n-api.service[61659]: Connection: close Apr 12 16:11:42 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:11:42 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:11:42 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:11:42 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:11:42 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVUIREaEpSCxaDHhRTy1-3vG98zUQQrkdSdA21f2O72s3N3rIDmLgBOdKtY1raaQOA2q8xobAID4T92RRWByg3TQMewePmiVUfKjOk4N3mk2Chaqhzu21Gl8iq5G39Tfr8LyTLfxMsGVguI0Q0Es6MN889SFcfwJK58-JrBG9wNTTI Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Project-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Tenant-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:11:42 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:11:42 user devstack@n-api.service[61659]: X-User: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:11:42 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:11:42 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:11:42 user devstack@n-api.service[61659]: X-User-Id: 880266e3fa4d4dd889648c10208a1f8e Apr 12 16:11:42 user devstack@n-api.service[61659]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:11:42 user devstack@n-api.service[61659]: method: > Apr 12 16:11:42 user devstack@n-api.service[61659]: exception: Cannot 'detach_volume' instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 while it is in vm_state rescued Apr 12 16:11:42 user devstack@n-api.service[61659]: action_args: {'server_id': '7f641c6b-b508-42a7-ae98-c2bfb841d798', 'id': '1f27a002-8dfc-4d90-aa35-ba16586d4366'} Apr 12 16:11:42 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 while it is in vm_state rescued Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 while it is in vm_state rescued Apr 12 16:11:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:11:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Returning 409 to user: Cannot 'detach_volume' instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 while it is in vm_state rescued {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:11:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-08151736-914d-40da-974a-451613cabfed tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments/1f27a002-8dfc-4d90-aa35-ba16586d4366" status: 409 len: 152 microversion: 2.1 time: 0.107504 Apr 12 16:11:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 208/633] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:11:42 2023] DELETE /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments/1f27a002-8dfc-4d90-aa35-ba16586d4366 => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-d00c56ec-20bd-4efd-84d7-ec65914ee73e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "POST /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/action" status: 202 len: 0 microversion: 2.1 time: 0.088466 Apr 12 16:11:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 214/634] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:11:42 2023] POST /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:43 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:43 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-805c6c32-d7fb-4a5d-9a31-889810a2c705 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 200 len: 1713 microversion: 2.1 time: 0.279413 Apr 12 16:11:43 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 213/635] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:42 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 1713 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:11:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-unplugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] Creating event network-vif-unplugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:11:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-b589e4d8-12ca-4432-ba8c-a305ac5f1a56 req-0ab2f373-8ee6-471e-8d66-c2c4fb7e6f0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029297 Apr 12 16:11:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 209/636] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:44 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:45 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:45 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:45 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6b5b2bf8-2a95-4d90-8210-3bf5f96e350c tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 200 len: 1769 microversion: 2.87 time: 0.191279 Apr 12 16:11:45 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 215/637] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:11:44 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 1769 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:11:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}, {"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}, {"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:11:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:11:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:11:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-0ad73b2f-7aa4-45fc-81c9-6fcb7860e7c8 req-f34824fc-35d3-4d6d-8b33-52150f4e2501 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.034431 Apr 12 16:11:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 214/638] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d62fef57-a9ee-469c-94b9-9566055144a4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.112508 Apr 12 16:11:48 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 210/639] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:11:48 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-interface => generated 282 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2511c44-8365-4e8c-9814-172547111b9f", "tag": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] Creating event network-changed:3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance f2511c44-8365-4e8c-9814-172547111b9f on user Apr 12 16:11:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-4d05fda9-bd19-410c-8730-e5c8dce9f779 req-18adb444-a241-4fb9-b9af-206fa773b3a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034858 Apr 12 16:11:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 216/640] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:11:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5ee872ad-d2df-4836-9f84-2a3067dc71bd tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/ips" status: 200 len: 107 microversion: 2.1 time: 0.041426 Apr 12 16:11:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 215/641] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:11:49 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/ips => generated 107 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8075886-2ccb-4609-9a35-e32f86fb14f9"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-3e64ea3d-247a-4d15-b7de-95ee917a1345 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283447 Apr 12 16:11:51 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 211/642] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:11:50 2023] POST /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] [instance: 6caa4977-8333-4171-8825-2c3bfb52f80b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] HTTP exception thrown: Instance 6caa4977-8333-4171-8825-2c3bfb52f80b could not be found. Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Request method failure captured: Apr 12 16:11:55 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b HTTP/1.1 Apr 12 16:11:55 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:11:55 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:11:55 user devstack@n-api.service[61658]: Connection: close Apr 12 16:11:55 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:11:55 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:11:55 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:11:55 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:11:55 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtZnoGZvPmRvpvQy5f3sTNmCpRxArwknVt1nQJUaZ6Xh16Pfxyt2Af3hW6e2bhJn9dHRFVGxhG_1nvPI2LFjVqA_8vEc5lanr_uEL8QNzng5YqTe5pAeINVSD3JG14XKMIptj4oU0F7wYte2VdKGRxwn-ULXMe3G81yN7NkZw9mwCAc Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Project-Id: 3deffbb4769b4985b038b4adcd82b018 Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerStableDeviceRescueTest-692889073 Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3deffbb4769b4985b038b4adcd82b018"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3deffbb4769b4985b038b4adcd82b018"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3deffbb4769b4985b038b4adcd82b018"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerStableDeviceRescueTest-692889073 Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Tenant-Id: 3deffbb4769b4985b038b4adcd82b018 Apr 12 16:11:55 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-692889073 Apr 12 16:11:55 user devstack@n-api.service[61658]: X-User: tempest-ServerStableDeviceRescueTest-692889073-project-member Apr 12 16:11:55 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:11:55 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:11:55 user devstack@n-api.service[61658]: X-User-Id: f76e286bd75a4cbaad7a7b735014f3d7 Apr 12 16:11:55 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerStableDeviceRescueTest-692889073-project-member Apr 12 16:11:55 user devstack@n-api.service[61658]: method: > Apr 12 16:11:55 user devstack@n-api.service[61658]: exception: Instance 6caa4977-8333-4171-8825-2c3bfb52f80b could not be found. Apr 12 16:11:55 user devstack@n-api.service[61658]: action_args: {'id': '6caa4977-8333-4171-8825-2c3bfb52f80b'} Apr 12 16:11:55 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6caa4977-8333-4171-8825-2c3bfb52f80b could not be found. Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6caa4977-8333-4171-8825-2c3bfb52f80b could not be found. Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6caa4977-8333-4171-8825-2c3bfb52f80b could not be found. Apr 12 16:11:55 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:11:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Returning 404 to user: Instance 6caa4977-8333-4171-8825-2c3bfb52f80b could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:11:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4f2facb5-3cc8-43d2-8cff-b094a4a0551c tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b" status: 404 len: 111 microversion: 2.1 time: 0.041407 Apr 12 16:11:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 217/643] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:55 2023] GET /compute/v2.1/servers/6caa4977-8333-4171-8825-2c3bfb52f80b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:11:55 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d80cb2fb-0038-40ec-98b6-8d4e7247a84a tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] Calling method '.version_select at 0x7fdee77e64d0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:55 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d80cb2fb-0038-40ec-98b6-8d4e7247a84a tempest-ServerStableDeviceRescueTest-692889073 tempest-ServerStableDeviceRescueTest-692889073-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356498122" status: 202 len: 0 microversion: 2.1 time: 0.026671 Apr 12 16:11:55 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 216/644] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 16:11:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356498122 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:58 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-47e6d44b-b8a2-45da-802d-1a767fb16cdc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1721 microversion: 2.1 time: 0.279648 Apr 12 16:11:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 212/645] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:58 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1721 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:58 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lazy-loading 'services' on Instance uuid f2511c44-8365-4e8c-9814-172547111b9f {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:11:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1a72c446-9c34-484a-8043-ba47e8125ea6 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments/e8075886-2ccb-4609-9a35-e32f86fb14f9" status: 202 len: 0 microversion: 2.1 time: 0.273574 Apr 12 16:11:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 218/646] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:11:58 2023] DELETE /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments/e8075886-2ccb-4609-9a35-e32f86fb14f9 => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:11:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:11:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c42863cf-5768-4b02-b6d0-196354155524 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046903 Apr 12 16:11:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 213/647] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:11:59 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:11:59 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:11:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-732b66f7-de0f-4ed6-84e1-03fba061541c tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1721 microversion: 2.1 time: 0.340622 Apr 12 16:11:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 217/648] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:11:58 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1721 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:07 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-46a92db4-0377-4ddb-b3c4-fd8478fb46b5 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a" status: 200 len: 1537 microversion: 2.1 time: 0.239958 Apr 12 16:12:07 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 219/649] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:12:06 2023] GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a => generated 1537 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-598591302", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "89a33fcd-81e9-4815-8644-d9b33ceb236b"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:07 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] validate_networks() for [('89a33fcd-81e9-4815-8644-d9b33ceb236b', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Getting quotas for project 280a9a56afca4ce591faca7a94eca4b2. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Getting quotas for user 38c60e84c47047e2886220f2ef54391d and project 280a9a56afca4ce591faca7a94eca4b2. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:12:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:12:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-096c329e-8b19-4941-9a88-ea4ed411824a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.703581 Apr 12 16:12:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 214/650] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:12:07 2023] POST /compute/v2.1/servers => generated 378 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:12:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-aec4ccd6-37b9-4152-a34e-39cc215b3a21 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:08 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-aec4ccd6-37b9-4152-a34e-39cc215b3a21 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:08 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-aec4ccd6-37b9-4152-a34e-39cc215b3a21 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-aec4ccd6-37b9-4152-a34e-39cc215b3a21 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 200 len: 1210 microversion: 2.1 time: 0.097044 Apr 12 16:12:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 218/651] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:12:08 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:09 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:09 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] Creating event network-changed:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:12:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-2a2648d4-c480-4ec1-adfa-68ebb343fc5b req-97ce1508-c515-47b0-9a1e-93454b131688 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034292 Apr 12 16:12:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 220/652] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7faa4f7-bc66-4311-92a9-c69ee614aa9c"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:09 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-9677477c-3cc7-4314-81a9-a9a9ec2f0786 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "POST /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.489199 Apr 12 16:12:09 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 215/653] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:12:09 2023] POST /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:11 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b613235-a905-466f-b9cc-a21a321a6313", "tag": "8a0b8df5-77c2-4888-b715-9f4bafba36b9"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:11 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=18 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] Creating event network-changed:8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance 1b613235-a905-466f-b9cc-a21a321a6313 on user Apr 12 16:12:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-d5027c8d-0030-4255-9b28-cf0ac8968a77 req-c119940f-24c5-48b0-8f9b-62496ed56308 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043842 Apr 12 16:12:11 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 219/654] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:11 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:13 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b613235-a905-466f-b9cc-a21a321a6313", "name": "network-vif-plugged", "status": "completed", "tag": "8a0b8df5-77c2-4888-b715-9f4bafba36b9"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=17 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:13 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] Creating event network-vif-plugged:8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance 1b613235-a905-466f-b9cc-a21a321a6313 on user Apr 12 16:12:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-424bf9a7-6e87-459d-8b8d-5a524cd07254 req-458a8876-fc27-41d6-922b-47f496331659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039848 Apr 12 16:12:13 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 221/655] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:15 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b613235-a905-466f-b9cc-a21a321a6313", "name": "network-vif-plugged", "status": "completed", "tag": "8a0b8df5-77c2-4888-b715-9f4bafba36b9"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:15 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:15 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] Creating event network-vif-plugged:8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance 1b613235-a905-466f-b9cc-a21a321a6313 on user Apr 12 16:12:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-0dcdca9f-0c30-4518-9054-a9f368c5edf3 req-a5cc8b6f-a69e-4d99-a8d9-ead97de8c591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037682 Apr 12 16:12:15 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 216/656] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:17 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lazy-loading 'services' on Instance uuid c307e623-c546-487f-ac16-5eb24d088e8a {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:12:17 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3e48c2b7-49a9-4da9-8f18-2193f3820a6d tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments/c7faa4f7-bc66-4311-92a9-c69ee614aa9c" status: 202 len: 0 microversion: 2.1 time: 0.204936 Apr 12 16:12:17 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 220/657] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:12:17 2023] DELETE /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments/c7faa4f7-bc66-4311-92a9-c69ee614aa9c => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7b778b8e-9311-4c30-b071-d1a14c8d7948 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059069 Apr 12 16:12:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 222/658] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:12:17 2023] GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-110dee1b-b4e3-4dbc-a029-2f4e2d2aa4a0 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.094363 Apr 12 16:12:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 217/659] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:12:20 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-interface => generated 283 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:21 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:21 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] Creating event network-changed:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:12:21 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-8b233ec1-cecb-4c17-8276-632237add106 req-b7745c8e-ea52-4e62-939b-ecfc21a0a24d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040328 Apr 12 16:12:21 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 221/660] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c4343d76-33c9-4ed9-9a63-3b7170118352 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/ips" status: 200 len: 104 microversion: 2.1 time: 0.059837 Apr 12 16:12:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 223/661] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:12:21 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/ips => generated 104 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce38c1b3-35b0-48cc-9b83-e9a676997784"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:22 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:22 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-af45d26c-85d6-4f16-9df9-b2f77112e5fe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.316406 Apr 12 16:12:22 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 218/662] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:12:22 2023] POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-volume_attachments => generated 194 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1597117228"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:26 user devstack@n-api.service[61657]: INFO nova.network.security_group_api [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Removing security group 7acd4a82-ecaa-49ef-a58f-ef93b0c196f4 from port a8837af3-03f7-4b3d-8a2a-746f2d8038ad Apr 12 16:12:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c4f47203-0ac2-4e60-bf30-0ec5d3cbf1af tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/action" status: 202 len: 0 microversion: 2.1 time: 0.891211 Apr 12 16:12:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 222/663] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:12:26 2023] POST /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/action => generated 0 bytes in 894 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:12:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] Creating event network-changed:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:12:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-bc1cebc5-df37-4872-86b9-3c43ed28e571 req-54eeefb7-124a-43e4-96a8-5baf30fede9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041734 Apr 12 16:12:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 224/664] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:12:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] Creating event network-changed:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:12:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-bf51c2ad-4c24-4b30-bfbc-45922594646d req-8fcf8965-9bae-4646-a8e0-83dfa8c8606c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032993 Apr 12 16:12:28 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 219/665] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:28 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'services' on Instance uuid 84683344-2893-4446-90ae-e64cd799eb20 {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:12:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a6e0a12f-a41c-4add-8510-bcf140fa96a7 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments/9c961fcc-0ff0-4275-9163-406662b265f8" status: 202 len: 0 microversion: 2.1 time: 0.224725 Apr 12 16:12:28 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 223/666] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:12:28 2023] DELETE /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments/9c961fcc-0ff0-4275-9163-406662b265f8 => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5ddbe0a8-2c09-4de3-864c-5fbce3613927 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071947 Apr 12 16:12:28 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 225/667] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:12:28 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c8af7257-631d-45e0-b83a-de0f9591b441 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045451 Apr 12 16:12:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 220/668] 10.0.0.210 () {64 vars in 1420 bytes} [Wed Apr 12 16:12:29 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:29 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:12:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-275e919c-2667-4c83-855e-37bcac4e1dfb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 204 len: 0 microversion: 2.20 time: 0.134647 Apr 12 16:12:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 224/669] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:12:29 2023] DELETE /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c1abec24caf74dc8a27b64c21a9d4a59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fa122cbabe94c6f93c862b4daf31e50', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:30 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-70b717b7-f8a5-44b4-a272-a51fe29cb427 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 200 len: 1710 microversion: 2.20 time: 0.297760 Apr 12 16:12:30 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 226/670] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:12:29 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 1710 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:12:30 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-unplugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:30 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:30 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:30 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] Creating event network-vif-unplugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:12:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-5f7492a8-09be-476e-adce-250fa6bd1c09 req-24ac38e0-5edb-4df6-b1e0-ef4eb4fdb176 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036228 Apr 12 16:12:30 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 221/671] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:30 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:30 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:30 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Going to try to stop instance {{(pid=61657) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 16:12:30 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-18eb31b6-3286-4f4d-a32e-a9dfaface1ae tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action" status: 202 len: 0 microversion: 2.1 time: 0.109889 Apr 12 16:12:30 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 225/672] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:12:30 2023] POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:30 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:30 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-9a3bfcdb-fab9-4250-a5e3-ce6eb0bde676 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1712 microversion: 2.1 time: 0.209879 Apr 12 16:12:30 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 227/673] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:12:30 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1712 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:12:31 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-unplugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:31 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:31 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:31 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:31 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] Creating event network-vif-unplugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:12:31 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-0c2b27e5-8b11-481f-908d-e9dc7fd08d5e req-1014a380-bca4-4733-9773-4cef48027554 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035119 Apr 12 16:12:31 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 222/674] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:32 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-plugged", "status": "completed", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}, {"server_uuid": "d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e", "name": "network-vif-deleted", "tag": "e2e566dd-85b6-43a5-b007-15d987e2af56"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:32 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Creating event network-vif-plugged:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:12:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] Creating event network-vif-deleted:e2e566dd-85b6-43a5-b007-15d987e2af56 for instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e on user Apr 12 16:12:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-4afea9f5-d475-4f46-b3f9-6208b5e7ec5b req-e93c1b18-18ee-46e8-bbf4-f7637aff4591 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029055 Apr 12 16:12:32 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 226/675] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:33 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:12:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-465c7700-c1a0-4b7e-bc32-60895ea33d0f req-5e89e90a-dac0-4721-bb57-182c7466694f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033977 Apr 12 16:12:33 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 228/676] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:33 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-27d7ee60-6831-4fa4-8c08-a2557774044c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 200 len: 1719 microversion: 2.1 time: 0.161425 Apr 12 16:12:33 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 223/677] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:12:33 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "16e6d04f-cd10-4e2b-ac3f-107c78071bfa"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:45 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lazy-loading 'flavor' on Instance uuid 0e8a977c-aa84-47c4-a838-b5f90820de1a {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:12:46 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-83b90f89-2813-41d0-b4a0-2b09a8d1ef5d tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a/action" status: 200 len: 29 microversion: 2.87 time: 0.761853 Apr 12 16:12:46 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 227/678] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:12:45 2023] POST /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a/action => generated 29 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=15 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=33 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:46 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2b13177a-dbfd-4608-8f63-ced8b42214e7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 200 len: 1775 microversion: 2.87 time: 0.167560 Apr 12 16:12:46 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 229/679] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:12:46 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 1775 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:12:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-unplugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:47 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=15 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:47 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:12:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] Creating event network-vif-unplugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:12:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-d1ee3322-5123-413c-ae31-3f2fd54fe891 req-ff29a523-ed7e-4c2e-9dd0-4a361812b2b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034300 Apr 12 16:12:47 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 224/680] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e6888f0a-c8f8-45e0-bc24-c5ad002021e7 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058887 Apr 12 16:12:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 228/681] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:12:49 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:12:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:12:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-4f1083a5-c885-4cbf-8b4a-5ec92f94671f req-c0621212-220e-4ae7-9458-7005e92e4d42 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052473 Apr 12 16:12:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 230/682] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:49 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:12:49 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7cb78c4c-3708-42ce-9b40-b7eda9188dc2 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f" status: 204 len: 0 microversion: 2.1 time: 0.208372 Apr 12 16:12:49 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 225/683] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:12:49 2023] DELETE /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:49 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a514f6d877a4ab0bec597fee13ce9db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28d940eae5394293b87cfced45911ab4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-2d6f8999-c82b-4fab-b96b-a4ee236d2a63 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f" status: 200 len: 1667 microversion: 2.1 time: 0.203494 Apr 12 16:12:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 229/684] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:12:49 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f => generated 1667 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:51 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-1a2a1177-50cb-4297-a86c-3e059139cc0d req-995d602d-59d7-47c9-ac8b-d047adf6080d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2511c44-8365-4e8c-9814-172547111b9f", "name": "network-vif-deleted", "tag": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1a2a1177-50cb-4297-a86c-3e059139cc0d req-995d602d-59d7-47c9-ac8b-d047adf6080d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1a2a1177-50cb-4297-a86c-3e059139cc0d req-995d602d-59d7-47c9-ac8b-d047adf6080d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1a2a1177-50cb-4297-a86c-3e059139cc0d req-995d602d-59d7-47c9-ac8b-d047adf6080d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:51 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2511c44-8365-4e8c-9814-172547111b9f", "name": "network-vif-unplugged", "status": "completed", "tag": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37"}, {"server_uuid": "f2511c44-8365-4e8c-9814-172547111b9f", "name": "network-vif-plugged", "status": "completed", "tag": "3d785c5d-4be8-4ade-92dd-d4bf7a16cb37"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:51 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-1a2a1177-50cb-4297-a86c-3e059139cc0d req-995d602d-59d7-47c9-ac8b-d047adf6080d service nova] Creating event network-vif-deleted:3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance f2511c44-8365-4e8c-9814-172547111b9f on user Apr 12 16:12:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-1a2a1177-50cb-4297-a86c-3e059139cc0d req-995d602d-59d7-47c9-ac8b-d047adf6080d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049729 Apr 12 16:12:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 231/685] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Creating event network-vif-unplugged:3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance f2511c44-8365-4e8c-9814-172547111b9f on user Apr 12 16:12:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] Creating event network-vif-plugged:3d785c5d-4be8-4ade-92dd-d4bf7a16cb37 for instance f2511c44-8365-4e8c-9814-172547111b9f on user Apr 12 16:12:51 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-4b186f6d-9684-497f-81bf-a96cb65c1894 req-89b8f2c0-80ef-419f-9ac0-c897556597a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.037642 Apr 12 16:12:51 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 226/686] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:51 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:53 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}, {"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:12:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:12:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-01329ff9-df0f-499a-86cc-2ab4596a9a42 req-38680ebc-fa0d-437e-9a95-8c1bb6c2856d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048029 Apr 12 16:12:53 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 230/687] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:53 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:58 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:58 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f4409056-2c03-4800-9e62-100700f7f2b9 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 200 len: 1493 microversion: 2.1 time: 0.198032 Apr 12 16:12:58 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 232/688] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:12:58 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 1493 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:59 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:12:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7538ec02-09d8-4587-842b-2fdd5e6106fc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 204 len: 0 microversion: 2.1 time: 0.115544 Apr 12 16:12:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 227/689] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:12:59 2023] DELETE /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:59 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:12:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-afb81147-73c5-417b-9f9d-30e67f7dbbbc tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 200 len: 1727 microversion: 2.1 time: 0.176623 Apr 12 16:12:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 231/690] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:12:59 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:12:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:12:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:12:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:12:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:12:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] Creating event network-vif-unplugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:12:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-ff55be40-d8da-4028-96cf-9b77a8e587d8 req-b02ee4b3-22ef-4c5c-b5ee-c0aef5b6687a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039477 Apr 12 16:12:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 233/691] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:12:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:01 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-deleted", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:01 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] Creating event network-vif-deleted:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:13:01 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-64432aa4-123b-40af-9686-5e6a2c576e7c req-cdb44396-5e73-492a-ac31-f853b05d3d22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031873 Apr 12 16:13:01 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 228/692] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:01 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}, {"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}, {"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}, {"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-unplugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}, {"server_uuid": "dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1", "name": "network-vif-plugged", "status": "completed", "tag": "18196ae0-d9c1-4814-8803-c4ba8ad4ab45"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:13:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:13:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:13:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Creating event network-vif-unplugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:13:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] Creating event network-vif-plugged:18196ae0-d9c1-4814-8803-c4ba8ad4ab45 for instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 on user Apr 12 16:13:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-202a8beb-3bdb-474f-8b6a-07959dc46cdc req-82744182-fcf3-4cf1-b505-14dbf4a90d1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.034657 Apr 12 16:13:01 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 232/693] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:01 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-0d7a9be2-16da-4253-b96c-1c37664c4e03 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046700 Apr 12 16:13:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 234/694] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:13:08 2023] GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] Creating event network-changed:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:13:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-ed8c5228-d87b-4eda-891b-654e4f7e6ac5 req-18a1e90a-c7a5-4bd1-b0cb-12ad4884afd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036892 Apr 12 16:13:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 233/695] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:13:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6445f194-85c4-4bc0-b5b0-5424e4bb413b tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a" status: 204 len: 0 microversion: 2.1 time: 0.131397 Apr 12 16:13:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 229/696] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:13:08 2023] DELETE /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:09 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b60166c7-5f02-4819-85b4-1ff7fe261df8 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a" status: 200 len: 1662 microversion: 2.1 time: 0.205271 Apr 12 16:13:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 235/697] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:08 2023] GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a => generated 1662 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:13:09 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "name": "network-vif-unplugged", "status": "completed", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] Creating event network-vif-unplugged:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:13:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-7a1aa90e-eaae-475f-9622-f4224fadcd97 req-87fee70a-ee4e-402d-9fa8-b06055cf2f30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032693 Apr 12 16:13:09 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 234/698] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "name": "network-vif-deleted", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] Creating event network-vif-deleted:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:13:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-6f01df38-86b3-4d4e-9480-52c68da1f96c req-ace276d6-bd6f-475a-8389-c5f8cdf6fab9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034279 Apr 12 16:13:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 230/699] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c307e623-c546-487f-ac16-5eb24d088e8a", "name": "network-vif-plugged", "status": "completed", "tag": "b6291ae2-bc79-4a35-a160-bff95fae3e8f"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] Creating event network-vif-plugged:b6291ae2-bc79-4a35-a160-bff95fae3e8f for instance c307e623-c546-487f-ac16-5eb24d088e8a on user Apr 12 16:13:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-0e61e53d-c0dc-4763-9390-d4546cb6bc62 req-fcad05f7-4496-4a0d-82a4-2939d78c2341 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032504 Apr 12 16:13:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 236/700] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=17 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:18 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-747b7362-d892-4bd0-9d12-f7fab92c5379 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054095 Apr 12 16:13:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 235/701] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:13:18 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] HTTP exception thrown: Instance 84683344-2893-4446-90ae-e64cd799eb20 is not attached to volume 9c961fcc-0ff0-4275-9163-406662b265f8 Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Request method failure captured: Apr 12 16:13:18 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments/9c961fcc-0ff0-4275-9163-406662b265f8 HTTP/1.1 Apr 12 16:13:18 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:13:18 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:13:18 user devstack@n-api.service[61659]: Connection: close Apr 12 16:13:18 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:13:18 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:13:18 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:13:18 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:13:18 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtdrPOEzq3NajGVio9y9Dtg1Ox8thkhzem7Nq1fBGQAzfZuOtOYBI1KDTxCByAg-s35vdnS3hlpPPN-tTXWeYvt5dhklovFZmL6sE_ooacxs7YWNGmJkg48xgOaF3ibSfUnWe2Px0E76EwM6IqXotkdqINcSLchI5RcFB-9TdNnFYL0 Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Project-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/236b9e609eb44071bc88971bff96931e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Tenant: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Tenant-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:13:18 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:13:18 user devstack@n-api.service[61659]: X-User: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:13:18 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:13:18 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:13:18 user devstack@n-api.service[61659]: X-User-Id: 16a68fa3490940ebaebc8d4ca5746f6e Apr 12 16:13:18 user devstack@n-api.service[61659]: X-User-Name: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:13:18 user devstack@n-api.service[61659]: method: > Apr 12 16:13:18 user devstack@n-api.service[61659]: exception: Instance 84683344-2893-4446-90ae-e64cd799eb20 is not attached to volume 9c961fcc-0ff0-4275-9163-406662b265f8 Apr 12 16:13:18 user devstack@n-api.service[61659]: action_args: {'server_id': '84683344-2893-4446-90ae-e64cd799eb20', 'id': '9c961fcc-0ff0-4275-9163-406662b265f8'} Apr 12 16:13:18 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9c961fcc-0ff0-4275-9163-406662b265f8. Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84683344-2893-4446-90ae-e64cd799eb20 is not attached to volume 9c961fcc-0ff0-4275-9163-406662b265f8 Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84683344-2893-4446-90ae-e64cd799eb20 is not attached to volume 9c961fcc-0ff0-4275-9163-406662b265f8 Apr 12 16:13:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Returning 404 to user: Instance 84683344-2893-4446-90ae-e64cd799eb20 is not attached to volume 9c961fcc-0ff0-4275-9163-406662b265f8 {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-64fcc057-1f79-4795-9c1e-cec349bfb133 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments/9c961fcc-0ff0-4275-9163-406662b265f8" status: 404 len: 154 microversion: 2.1 time: 0.119338 Apr 12 16:13:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 231/702] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:13:18 2023] DELETE /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20/os-volume_attachments/9c961fcc-0ff0-4275-9163-406662b265f8 => generated 154 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=19 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=33 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] HTTP exception thrown: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Request method failure captured: Apr 12 16:13:20 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e HTTP/1.1 Apr 12 16:13:20 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:13:20 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:13:20 user devstack@n-api.service[61658]: Connection: close Apr 12 16:13:20 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:13:20 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:13:20 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:13:20 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:13:20 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVXTjbZyEg_LmQ8Bw4CRXe_aQ4Io08dmEqiq6DckeHL3labzmb0ucJ2h2alwuZ20sdvv-eJLGhEqIK5nt30N8nNaa6-_29GU64tUxEQo1PWr3GGx_x7Tuo6hglRY7wblhnOzAk_wGgQ-8En_mDySIXGvccofwCJlhlruOYkLCn3Z6Q Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Project-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Tenant-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:20 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:13:20 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:13:20 user devstack@n-api.service[61658]: X-User-Id: c1abec24caf74dc8a27b64c21a9d4a59 Apr 12 16:13:20 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:20 user devstack@n-api.service[61658]: method: > Apr 12 16:13:20 user devstack@n-api.service[61658]: exception: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:20 user devstack@n-api.service[61658]: action_args: {'id': 'd9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e'} Apr 12 16:13:20 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:20 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Returning 404 to user: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e9b99bc1-d9bd-4357-9b32-63ac625b686d tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 404 len: 111 microversion: 2.20 time: 0.053826 Apr 12 16:13:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 237/703] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:13:20 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:13:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fb19f615-497f-488c-8919-60b230833324 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '.version_select at 0x7fdee7715090>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fb19f615-497f-488c-8919-60b230833324 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-746668212" status: 204 len: 0 microversion: 2.20 time: 0.028172 Apr 12 16:13:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 236/704] 10.0.0.210 () {64 vars in 1336 bytes} [Wed Apr 12 16:13:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-746668212 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-70e3b606-31ae-4a30-b6c6-2cbf1a45bbfe tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1689 microversion: 2.1 time: 0.180634 Apr 12 16:13:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 232/705] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:21 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1689 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:21 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:13:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-3d51ac07-efb0-40ea-9d1b-f6176c72d1c5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 204 len: 0 microversion: 2.1 time: 0.167464 Apr 12 16:13:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 238/706] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:13:21 2023] DELETE /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-unplugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:21 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:21 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9e3c8785-aa99-4fd1-a864-d3ba5e4bf370 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 200 len: 1541 microversion: 2.1 time: 0.295365 Apr 12 16:13:21 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 237/707] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:21 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 1541 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:13:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] Creating event network-vif-unplugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:13:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-6d4a4e42-d365-4109-be8d-cb9e793e81cd req-4ef65673-85df-449d-8675-48140d8b806c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030222 Apr 12 16:13:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 233/708] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-05432f59-1d28-437a-a05c-04820a345b2b req-2473d0aa-d41a-4838-9dd2-4fde9db218fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-deleted", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-05432f59-1d28-437a-a05c-04820a345b2b req-2473d0aa-d41a-4838-9dd2-4fde9db218fa service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-05432f59-1d28-437a-a05c-04820a345b2b req-2473d0aa-d41a-4838-9dd2-4fde9db218fa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-05432f59-1d28-437a-a05c-04820a345b2b req-2473d0aa-d41a-4838-9dd2-4fde9db218fa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-05432f59-1d28-437a-a05c-04820a345b2b req-2473d0aa-d41a-4838-9dd2-4fde9db218fa service nova] Creating event network-vif-deleted:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:13:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-05432f59-1d28-437a-a05c-04820a345b2b req-2473d0aa-d41a-4838-9dd2-4fde9db218fa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037218 Apr 12 16:13:23 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 239/709] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:23 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] HTTP exception thrown: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Request method failure captured: Apr 12 16:13:23 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e HTTP/1.1 Apr 12 16:13:23 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:13:23 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:13:23 user devstack@n-api.service[61657]: Connection: close Apr 12 16:13:23 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:13:23 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:13:23 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:13:23 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:13:23 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVXTjbZyEg_LmQ8Bw4CRXe_aQ4Io08dmEqiq6DckeHL3labzmb0ucJ2h2alwuZ20sdvv-eJLGhEqIK5nt30N8nNaa6-_29GU64tUxEQo1PWr3GGx_x7Tuo6hglRY7wblhnOzAk_wGgQ-8En_mDySIXGvccofwCJlhlruOYkLCn3Z6Q Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Project-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Tenant-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:23 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:13:23 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:13:23 user devstack@n-api.service[61657]: X-User-Id: c1abec24caf74dc8a27b64c21a9d4a59 Apr 12 16:13:23 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:23 user devstack@n-api.service[61657]: method: > Apr 12 16:13:23 user devstack@n-api.service[61657]: exception: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61657]: action_args: {'id': 'd9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e'} Apr 12 16:13:23 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Returning 404 to user: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:23 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ea743001-0d52-47cc-a919-86a0534b49eb tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 404 len: 111 microversion: 2.20 time: 0.039298 Apr 12 16:13:23 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 238/710] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:13:23 2023] DELETE /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] HTTP exception thrown: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Request method failure captured: Apr 12 16:13:23 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e HTTP/1.1 Apr 12 16:13:23 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:13:23 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:13:23 user devstack@n-api.service[61659]: Connection: close Apr 12 16:13:23 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:13:23 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:13:23 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:13:23 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:13:23 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVXTjbZyEg_LmQ8Bw4CRXe_aQ4Io08dmEqiq6DckeHL3labzmb0ucJ2h2alwuZ20sdvv-eJLGhEqIK5nt30N8nNaa6-_29GU64tUxEQo1PWr3GGx_x7Tuo6hglRY7wblhnOzAk_wGgQ-8En_mDySIXGvccofwCJlhlruOYkLCn3Z6Q Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Project-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Tenant-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:23 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:13:23 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:13:23 user devstack@n-api.service[61659]: X-User-Id: c1abec24caf74dc8a27b64c21a9d4a59 Apr 12 16:13:23 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:23 user devstack@n-api.service[61659]: method: > Apr 12 16:13:23 user devstack@n-api.service[61659]: exception: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61659]: action_args: {'id': 'd9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e'} Apr 12 16:13:23 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. Apr 12 16:13:23 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Returning 404 to user: Instance d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-02a4cb55-a2d0-4e9d-b372-fde94634579a tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e" status: 404 len: 111 microversion: 2.20 time: 0.031147 Apr 12 16:13:23 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 234/711] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:13:23 2023] GET /compute/v2.1/servers/d9c6c6cb-aa1f-41ce-beb7-c5a74d5b5e5e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:13:23 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84683344-2893-4446-90ae-e64cd799eb20", "name": "network-vif-plugged", "status": "completed", "tag": "a8837af3-03f7-4b3d-8a2a-746f2d8038ad"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] Creating event network-vif-plugged:a8837af3-03f7-4b3d-8a2a-746f2d8038ad for instance 84683344-2893-4446-90ae-e64cd799eb20 on user Apr 12 16:13:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-30f2da90-7523-4a0d-b6a5-2c0b88c1592b req-dd0c9ae6-e7b6-4144-a344-3c2fb93beaca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043938 Apr 12 16:13:23 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 240/712] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] HTTP exception thrown: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Request method failure captured: Apr 12 16:13:25 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 HTTP/1.1 Apr 12 16:13:25 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:13:25 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:13:25 user devstack@n-api.service[61657]: Connection: close Apr 12 16:13:25 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:13:25 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:13:25 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:13:25 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:13:25 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVXTjbZyEg_LmQ8Bw4CRXe_aQ4Io08dmEqiq6DckeHL3labzmb0ucJ2h2alwuZ20sdvv-eJLGhEqIK5nt30N8nNaa6-_29GU64tUxEQo1PWr3GGx_x7Tuo6hglRY7wblhnOzAk_wGgQ-8En_mDySIXGvccofwCJlhlruOYkLCn3Z6Q Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Project-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Tenant-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:25 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:13:25 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:13:25 user devstack@n-api.service[61657]: X-User-Id: c1abec24caf74dc8a27b64c21a9d4a59 Apr 12 16:13:25 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:25 user devstack@n-api.service[61657]: method: > Apr 12 16:13:25 user devstack@n-api.service[61657]: exception: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61657]: action_args: {'id': 'fc19fd8d-3285-4ceb-8714-a0ba139f3045'} Apr 12 16:13:25 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Returning 404 to user: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9c212536-6d52-4436-8094-616979e0f7df tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 404 len: 111 microversion: 2.20 time: 0.035104 Apr 12 16:13:25 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 239/713] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:13:25 2023] DELETE /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] [instance: fc19fd8d-3285-4ceb-8714-a0ba139f3045] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:25 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] HTTP exception thrown: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Request method failure captured: Apr 12 16:13:25 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 HTTP/1.1 Apr 12 16:13:25 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:13:25 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:13:25 user devstack@n-api.service[61659]: Connection: close Apr 12 16:13:25 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:13:25 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:13:25 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:13:25 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:13:25 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVXTjbZyEg_LmQ8Bw4CRXe_aQ4Io08dmEqiq6DckeHL3labzmb0ucJ2h2alwuZ20sdvv-eJLGhEqIK5nt30N8nNaa6-_29GU64tUxEQo1PWr3GGx_x7Tuo6hglRY7wblhnOzAk_wGgQ-8En_mDySIXGvccofwCJlhlruOYkLCn3Z6Q Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Openstack-Nova-Api-Version: 2.20 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Project-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/1fa122cbabe94c6f93c862b4daf31e50"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Tenant-Id: 1fa122cbabe94c6f93c862b4daf31e50 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-292107264 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:25 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:13:25 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:13:25 user devstack@n-api.service[61659]: X-User-Id: c1abec24caf74dc8a27b64c21a9d4a59 Apr 12 16:13:25 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeShelveTestJSON-292107264-project-member Apr 12 16:13:25 user devstack@n-api.service[61659]: method: > Apr 12 16:13:25 user devstack@n-api.service[61659]: exception: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61659]: action_args: {'id': 'fc19fd8d-3285-4ceb-8714-a0ba139f3045'} Apr 12 16:13:25 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. Apr 12 16:13:25 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:25 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] Returning 404 to user: Instance fc19fd8d-3285-4ceb-8714-a0ba139f3045 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:25 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-9a30fa8e-006a-4783-a2e4-45977597c3c7 tempest-AttachVolumeShelveTestJSON-292107264 tempest-AttachVolumeShelveTestJSON-292107264-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045" status: 404 len: 111 microversion: 2.20 time: 0.033980 Apr 12 16:13:25 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 235/714] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:13:25 2023] GET /compute/v2.1/servers/fc19fd8d-3285-4ceb-8714-a0ba139f3045 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:33 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-940b7721-4cb7-4244-8d57-ab6b19de1de3 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.119571 Apr 12 16:13:33 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 241/715] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:13:33 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-interface => generated 282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:34 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] Creating event network-changed:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:13:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-d84d178b-0e31-485c-8ae9-75fd5aa2b2be req-75062546-afd9-411e-b850-e410033eab8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034189 Apr 12 16:13:34 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 240/716] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:35 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lazy-loading 'services' on Instance uuid 7f641c6b-b508-42a7-ae98-c2bfb841d798 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:13:35 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2bc13b33-4c81-4680-b8c3-65792e219b16 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments/1f27a002-8dfc-4d90-aa35-ba16586d4366" status: 202 len: 0 microversion: 2.1 time: 0.448208 Apr 12 16:13:35 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 236/717] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:13:35 2023] DELETE /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments/1f27a002-8dfc-4d90-aa35-ba16586d4366 => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-44f32b02-3325-4f45-9942-6f0f92300c5f tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045886 Apr 12 16:13:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 242/718] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:13:35 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:36 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a59cd7bf-ea09-4015-aee1-a74c4e0f7321 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 200 len: 1755 microversion: 2.87 time: 0.169087 Apr 12 16:13:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 241/719] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:13:36 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:13:36 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] Creating event network-changed:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:13:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-e5c2824b-80ea-48b2-b8ce-1f6899264ebf req-66308a0c-a562-4757-bbe9-4e56de3e8d73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038790 Apr 12 16:13:36 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 237/720] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:39 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f HTTP/1.1 Apr 12 16:13:39 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:13:39 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:13:39 user devstack@n-api.service[61658]: Connection: close Apr 12 16:13:39 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:13:39 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:13:39 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:13:39 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:13:39 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:39 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:39 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:39 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:13:39 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:13:39 user devstack@n-api.service[61658]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:39 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:39 user devstack@n-api.service[61658]: method: > Apr 12 16:13:39 user devstack@n-api.service[61658]: exception: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:39 user devstack@n-api.service[61658]: action_args: {'id': 'f2511c44-8365-4e8c-9814-172547111b9f'} Apr 12 16:13:39 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:39 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-14f7893f-ec69-4a03-bb05-ca981c6ece68 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f" status: 404 len: 111 microversion: 2.1 time: 0.045904 Apr 12 16:13:39 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 243/721] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:39 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:39 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1c18865b-fc3c-4676-b093-81d55115fe67 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '.version_select at 0x7fdee7a76680>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:39 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1c18865b-fc3c-4676-b093-81d55115fe67 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846852248" status: 202 len: 0 microversion: 2.1 time: 0.026696 Apr 12 16:13:39 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 242/722] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 16:13:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1846852248 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:42 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f HTTP/1.1 Apr 12 16:13:42 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:13:42 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:13:42 user devstack@n-api.service[61659]: Connection: close Apr 12 16:13:42 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:13:42 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:13:42 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:13:42 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:13:42 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:42 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:42 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:42 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:13:42 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:13:42 user devstack@n-api.service[61659]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:42 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:42 user devstack@n-api.service[61659]: method: > Apr 12 16:13:42 user devstack@n-api.service[61659]: exception: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61659]: action_args: {'id': 'f2511c44-8365-4e8c-9814-172547111b9f'} Apr 12 16:13:42 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8aadd6a2-7b58-4945-bb99-95351ee59640 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f" status: 404 len: 111 microversion: 2.1 time: 0.037800 Apr 12 16:13:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 238/723] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:13:42 2023] DELETE /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: f2511c44-8365-4e8c-9814-172547111b9f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:42 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f HTTP/1.1 Apr 12 16:13:42 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:13:42 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:13:42 user devstack@n-api.service[61658]: Connection: close Apr 12 16:13:42 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:13:42 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:13:42 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:13:42 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:13:42 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:42 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:42 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:42 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:13:42 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:13:42 user devstack@n-api.service[61658]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:42 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:42 user devstack@n-api.service[61658]: method: > Apr 12 16:13:42 user devstack@n-api.service[61658]: exception: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61658]: action_args: {'id': 'f2511c44-8365-4e8c-9814-172547111b9f'} Apr 12 16:13:42 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. Apr 12 16:13:42 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance f2511c44-8365-4e8c-9814-172547111b9f could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-be92e60f-1139-4b35-a583-cd6376c26b0d tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f" status: 404 len: 111 microversion: 2.1 time: 0.031913 Apr 12 16:13:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 244/724] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:42 2023] GET /compute/v2.1/servers/f2511c44-8365-4e8c-9814-172547111b9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:45 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf HTTP/1.1 Apr 12 16:13:45 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:13:45 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:13:45 user devstack@n-api.service[61657]: Connection: close Apr 12 16:13:45 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:13:45 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:13:45 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:13:45 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:13:45 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61657]: method: > Apr 12 16:13:45 user devstack@n-api.service[61657]: exception: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: action_args: {'id': '357dd90d-8c53-4193-ad64-edfa894116cf'} Apr 12 16:13:45 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-061cb67b-72a1-4d9b-a5d4-f24014672204 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf" status: 404 len: 111 microversion: 2.1 time: 0.036285 Apr 12 16:13:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 243/725] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:13:45 2023] DELETE /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 357dd90d-8c53-4193-ad64-edfa894116cf] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:45 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf HTTP/1.1 Apr 12 16:13:45 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:13:45 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:13:45 user devstack@n-api.service[61659]: Connection: close Apr 12 16:13:45 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:13:45 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:13:45 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:13:45 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:13:45 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61659]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:45 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61659]: method: > Apr 12 16:13:45 user devstack@n-api.service[61659]: exception: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61659]: action_args: {'id': '357dd90d-8c53-4193-ad64-edfa894116cf'} Apr 12 16:13:45 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. Apr 12 16:13:45 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance 357dd90d-8c53-4193-ad64-edfa894116cf could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1d5715f8-1d2d-4f16-b6ea-f7d11e8deaca tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf" status: 404 len: 111 microversion: 2.1 time: 0.034190 Apr 12 16:13:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 239/726] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:45 2023] GET /compute/v2.1/servers/357dd90d-8c53-4193-ad64-edfa894116cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:45 user devstack@n-api.service[61658]: request: DELETE /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 HTTP/1.1 Apr 12 16:13:45 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:13:45 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:13:45 user devstack@n-api.service[61658]: Connection: close Apr 12 16:13:45 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:13:45 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:13:45 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:13:45 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:13:45 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61658]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:45 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61658]: method: > Apr 12 16:13:45 user devstack@n-api.service[61658]: exception: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61658]: action_args: {'id': 'ad0cece6-9b26-4c87-9e48-2c0437cb9190'} Apr 12 16:13:45 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-419b4a93-06ab-4fb9-b8be-bd3c953225bb tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190" status: 404 len: 111 microversion: 2.1 time: 0.035353 Apr 12 16:13:45 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 245/727] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:13:45 2023] DELETE /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: ad0cece6-9b26-4c87-9e48-2c0437cb9190] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:45 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 HTTP/1.1 Apr 12 16:13:45 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:13:45 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:13:45 user devstack@n-api.service[61657]: Connection: close Apr 12 16:13:45 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:13:45 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:13:45 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:13:45 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:13:45 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:45 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:45 user devstack@n-api.service[61657]: method: > Apr 12 16:13:45 user devstack@n-api.service[61657]: exception: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: action_args: {'id': 'ad0cece6-9b26-4c87-9e48-2c0437cb9190'} Apr 12 16:13:45 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. Apr 12 16:13:45 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance ad0cece6-9b26-4c87-9e48-2c0437cb9190 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-19d79ced-74bf-4ad3-bbe1-8f2bbbd886ad tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190" status: 404 len: 111 microversion: 2.1 time: 0.037446 Apr 12 16:13:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 244/728] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:45 2023] GET /compute/v2.1/servers/ad0cece6-9b26-4c87-9e48-2c0437cb9190 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:47 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 HTTP/1.1 Apr 12 16:13:47 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:13:47 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:13:47 user devstack@n-api.service[61659]: Connection: close Apr 12 16:13:47 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:13:47 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:13:47 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:13:47 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:13:47 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:47 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:47 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:47 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:13:47 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:13:47 user devstack@n-api.service[61659]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:47 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:47 user devstack@n-api.service[61659]: method: > Apr 12 16:13:47 user devstack@n-api.service[61659]: exception: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61659]: action_args: {'id': '920c6512-180d-46e1-b0cf-240d34c3fc97'} Apr 12 16:13:47 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-36cfa4ee-8f07-41c0-a2ad-a4fa394adbe4 tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97" status: 404 len: 111 microversion: 2.1 time: 0.040886 Apr 12 16:13:47 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 240/729] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:13:47 2023] DELETE /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] [instance: 920c6512-180d-46e1-b0cf-240d34c3fc97] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:47 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] HTTP exception thrown: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Request method failure captured: Apr 12 16:13:47 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 HTTP/1.1 Apr 12 16:13:47 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:13:47 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:13:47 user devstack@n-api.service[61658]: Connection: close Apr 12 16:13:47 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:13:47 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:13:47 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:13:47 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:13:47 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVhL-Z24D-_X_LuPDxn_jRTYH-AZqa_huezA4k8B4lubZsBa0LtllsziWGjqd4yjM_C9thzAaxIwaoyAelCK4alPfe4F7cUXIFLyvUnQUtsNpwC34-yIy0Au4l1x5kLsPuwRBHleGEVZZptOogdgOxiAlNsWAmbik-1755qXXD4Zv4 Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Project-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/28d940eae5394293b87cfced45911ab4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/28d940eae5394293b87cfced45911ab4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Tenant-Id: 28d940eae5394293b87cfced45911ab4 Apr 12 16:13:47 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-288610953 Apr 12 16:13:47 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:47 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:13:47 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:13:47 user devstack@n-api.service[61658]: X-User-Id: 5a514f6d877a4ab0bec597fee13ce9db Apr 12 16:13:47 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeNegativeTest-288610953-project-member Apr 12 16:13:47 user devstack@n-api.service[61658]: method: > Apr 12 16:13:47 user devstack@n-api.service[61658]: exception: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61658]: action_args: {'id': '920c6512-180d-46e1-b0cf-240d34c3fc97'} Apr 12 16:13:47 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. Apr 12 16:13:47 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:47 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] Returning 404 to user: Instance 920c6512-180d-46e1-b0cf-240d34c3fc97 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:47 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-339887ab-71d0-42a5-b6fd-7182f5d88cce tempest-AttachVolumeNegativeTest-288610953 tempest-AttachVolumeNegativeTest-288610953-project-member] 10.0.0.210 "GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97" status: 404 len: 111 microversion: 2.1 time: 0.047520 Apr 12 16:13:47 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 246/730] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:47 2023] GET /compute/v2.1/servers/920c6512-180d-46e1-b0cf-240d34c3fc97 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=28 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:13:49 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 HTTP/1.1 Apr 12 16:13:49 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:13:49 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:13:49 user devstack@n-api.service[61657]: Connection: close Apr 12 16:13:49 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:13:49 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:13:49 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:13:49 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:13:49 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:13:49 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61657]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:13:49 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:13:49 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:13:49 user devstack@n-api.service[61657]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:13:49 user devstack@n-api.service[61657]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:13:49 user devstack@n-api.service[61657]: method: > Apr 12 16:13:49 user devstack@n-api.service[61657]: exception: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61657]: action_args: {'id': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'} Apr 12 16:13:49 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-774a2aed-4d04-4916-892f-211fbb278e6f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 404 len: 111 microversion: 2.1 time: 0.072547 Apr 12 16:13:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 245/731] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:49 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=20 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:49 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:13:49 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments HTTP/1.1 Apr 12 16:13:49 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:13:49 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:13:49 user devstack@n-api.service[61659]: Connection: close Apr 12 16:13:49 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:13:49 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:13:49 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:13:49 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:13:49 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:13:49 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61659]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:13:49 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:13:49 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:13:49 user devstack@n-api.service[61659]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:13:49 user devstack@n-api.service[61659]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:13:49 user devstack@n-api.service[61659]: method: > Apr 12 16:13:49 user devstack@n-api.service[61659]: exception: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61659]: action_args: {'server_id': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'} Apr 12 16:13:49 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:49 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-bbeb6a3d-21cb-4c05-bcaf-d8b15d673336 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031427 Apr 12 16:13:49 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 241/732] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:13:49 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1/os-volume_attachments => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:13:49 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 HTTP/1.1 Apr 12 16:13:49 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:13:49 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:13:49 user devstack@n-api.service[61658]: Connection: close Apr 12 16:13:49 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:13:49 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:13:49 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:13:49 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:13:49 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:13:49 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:13:49 user devstack@n-api.service[61658]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:13:49 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:13:49 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:13:49 user devstack@n-api.service[61658]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:13:49 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:13:49 user devstack@n-api.service[61658]: method: > Apr 12 16:13:49 user devstack@n-api.service[61658]: exception: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61658]: action_args: {'id': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'} Apr 12 16:13:49 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:13:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1311c9a7-265e-459a-a614-4d71bd613e27 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 404 len: 111 microversion: 2.1 time: 0.031879 Apr 12 16:13:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 247/733] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:49 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1551944182", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "e6694358-e361-4952-b859-93755c11721e"}], "security_groups": [{"name": "tempest-securitygroup--384785848"}], "key_name": "tempest-keypair-1923467613", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] validate_networks() for [('e6694358-e361-4952-b859-93755c11721e', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for user 1a699b3ba8304eadb8a53d465ea340cf and project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:13:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:13:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-112e533a-ce9a-48eb-b86a-b00508431578 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.785980 Apr 12 16:13:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 246/734] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:13:49 2023] POST /compute/v2.1/servers => generated 403 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:13:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-47150374-f2aa-4dcf-bd49-17f4633680ca tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-47150374-f2aa-4dcf-bd49-17f4633680ca tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:50 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-47150374-f2aa-4dcf-bd49-17f4633680ca tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:50 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-47150374-f2aa-4dcf-bd49-17f4633680ca tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976" status: 200 len: 1233 microversion: 2.1 time: 0.092278 Apr 12 16:13:50 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 242/735] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:50 2023] GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976 => generated 1233 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:13:51 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5b42c47c-06e0-42b2-b5bc-3acd91321bab tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Action: 'create', calling method: .version_select at 0x7fdee76137f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-870598293"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:52 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5b42c47c-06e0-42b2-b5bc-3acd91321bab tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.496254 Apr 12 16:13:52 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 248/736] 10.0.0.210 () {64 vars in 1232 bytes} [Wed Apr 12 16:13:51 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 498 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 12 16:13:52 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f3f0c39e-7366-42dc-b129-6efb0871039b tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee76b28c0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:52 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f3f0c39e-7366-42dc-b129-6efb0871039b tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 200 len: 344 microversion: 2.1 time: 0.065073 Apr 12 16:13:52 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 247/737] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:13:52 2023] GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8034dc9e-8d3e-4f88-a4b7-0823823ac66e tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee756e8c0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8034dc9e-8d3e-4f88-a4b7-0823823ac66e tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 200 len: 345 microversion: 2.1 time: 0.065986 Apr 12 16:13:53 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 243/738] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:13:53 2023] GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 345 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:53 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f253d0d6-ee0e-45df-a9e8-64a46128626a tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Action: 'create', calling method: .version_select at 0x7fdee767b880>, body: {"snapshot": {"volume_id": "5274a0c4-0f77-4d97-adc7-ea20b41e90b0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-466192486"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:53 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] Creating event network-changed:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:13:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-c3c72a4b-f224-421a-8aa0-0072f3736da4 req-2516a175-a045-4ec3-ade4-cfedf21267ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055269 Apr 12 16:13:53 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 248/739] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:53 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f253d0d6-ee0e-45df-a9e8-64a46128626a tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.197042 Apr 12 16:13:53 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 249/740] 10.0.0.210 () {64 vars in 1239 bytes} [Wed Apr 12 16:13:53 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:13:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-815e2937-b16c-4bce-b64e-18d4f707158c tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee8621e10>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-815e2937-b16c-4bce-b64e-18d4f707158c tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 200 len: 286 microversion: 2.1 time: 0.040036 Apr 12 16:13:53 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 244/741] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:13:53 2023] GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:13:53 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7c1a8994-839b-49f0-af8e-e589034d52e8 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee76b2830>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7c1a8994-839b-49f0-af8e-e589034d52e8 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.046450 Apr 12 16:13:53 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 249/742] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 16:13:53 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:53 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-d37f4860-7b16-466e-b753-bd020502291d tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee7613b50>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:53 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-d37f4860-7b16-466e-b753-bd020502291d tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 200 len: 286 microversion: 2.1 time: 0.048079 Apr 12 16:13:53 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 250/743] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:13:53 2023] GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:54 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-35013185-d478-47b8-b39b-33eca6539178 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee756f130>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-35013185-d478-47b8-b39b-33eca6539178 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 200 len: 286 microversion: 2.1 time: 0.035337 Apr 12 16:13:54 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 245/744] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:13:54 2023] GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:55 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "name": "network-vif-plugged", "status": "completed", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:55 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] Creating event network-vif-plugged:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:13:55 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a265d8e7-955b-4f5b-9061-6950ab6e39fc req-ff6e4803-66f8-40c6-adff-28c15584b732 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045729 Apr 12 16:13:55 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 250/745] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b3fe165a-8004-4bb2-929f-8fbe4e0c6990 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee7611900>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b3fe165a-8004-4bb2-929f-8fbe4e0c6990 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 200 len: 287 microversion: 2.1 time: 0.051512 Apr 12 16:13:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 251/746] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:13:55 2023] GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9637530a-376d-4ea0-858f-7e70a4bdff5b tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee756fc70>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-9637530a-376d-4ea0-858f-7e70a4bdff5b tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 202 len: 0 microversion: 2.1 time: 0.100938 Apr 12 16:13:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 246/747] 10.0.0.210 () {62 vars in 1331 bytes} [Wed Apr 12 16:13:55 2023] DELETE /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 12 16:13:55 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9d4b3330-768b-421c-be00-76f42af3b4f3 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee7716710>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:55 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9d4b3330-768b-421c-be00-76f42af3b4f3 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 200 len: 286 microversion: 2.1 time: 0.039294 Apr 12 16:13:55 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 251/748] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:13:55 2023] GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:57 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2ecee484-6b98-4ed7-86bf-1aa97a24ca66 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee767bb50>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:57 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2ecee484-6b98-4ed7-86bf-1aa97a24ca66 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 200 len: 286 microversion: 2.1 time: 0.041693 Apr 12 16:13:57 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 252/749] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:13:56 2023] GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:57 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "name": "network-vif-plugged", "status": "completed", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:57 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:57 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] Creating event network-vif-plugged:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:13:57 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-59e4a30b-3590-4a9d-8b4c-cc10e9af19cf req-d860d009-205f-412b-a87e-5784199fb109 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Apr 12 16:13:57 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 247/750] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7fbab934-1a2c-4b29-a33a-261ebeb895f2 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee88fe680>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-7fbab934-1a2c-4b29-a33a-261ebeb895f2 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] HTTP exception thrown: Snapshot dc186401-33c1-4b74-99ed-f93519e966e7 could not be found. Apr 12 16:13:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7fbab934-1a2c-4b29-a33a-261ebeb895f2 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Request method failure captured: Apr 12 16:13:58 user devstack@n-api.service[61657]: request: GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 HTTP/1.1 Apr 12 16:13:58 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:13:58 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:13:58 user devstack@n-api.service[61657]: Connection: close Apr 12 16:13:58 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:13:58 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:13:58 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:13:58 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:13:58 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNti_v3NJB30pfmioijNZwHpY05i9-e2xP64lABlbgut-AZ6kSqbMD0939xJpWXUXRCzUoxQeyGfGY9gdKHT86NOS0qZqhOPPj13i4jeEfWVp66z7NuHWcwnk3BpEQxR0Tx0otWrFCbkJAxIACeD5xlDHqnyGs5biSdecUXWmMxOK8JY Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Project-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Tenant-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:13:58 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:13:58 user devstack@n-api.service[61657]: X-User: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:13:58 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:13:58 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:13:58 user devstack@n-api.service[61657]: X-User-Id: ed0447936c7d40c1bb8a847d5b0219ca Apr 12 16:13:58 user devstack@n-api.service[61657]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:13:58 user devstack@n-api.service[61657]: method: Apr 12 16:13:58 user devstack@n-api.service[61657]: exception: Snapshot dc186401-33c1-4b74-99ed-f93519e966e7 could not be found. Apr 12 16:13:58 user devstack@n-api.service[61657]: action_args: {'id': 'dc186401-33c1-4b74-99ed-f93519e966e7'} Apr 12 16:13:58 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot dc186401-33c1-4b74-99ed-f93519e966e7 could not be found. (HTTP 404) (Request-ID: req-32b78d0d-22e9-4408-b7ad-fba224731752) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot dc186401-33c1-4b74-99ed-f93519e966e7 could not be found. Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot dc186401-33c1-4b74-99ed-f93519e966e7 could not be found. Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot dc186401-33c1-4b74-99ed-f93519e966e7 could not be found. Apr 12 16:13:58 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:13:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7fbab934-1a2c-4b29-a33a-261ebeb895f2 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Returning 404 to user: Snapshot dc186401-33c1-4b74-99ed-f93519e966e7 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7fbab934-1a2c-4b29-a33a-261ebeb895f2 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7" status: 404 len: 111 microversion: 2.1 time: 0.046568 Apr 12 16:13:58 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 252/751] 10.0.0.210 () {62 vars in 1328 bytes} [Wed Apr 12 16:13:58 2023] GET /compute/v2.1/os-snapshots/dc186401-33c1-4b74-99ed-f93519e966e7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:58 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c9344a22-efeb-43a1-9955-973446cae992 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee7610700>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:58 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c9344a22-efeb-43a1-9955-973446cae992 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 202 len: 0 microversion: 2.1 time: 0.067950 Apr 12 16:13:58 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 253/752] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:13:58 2023] DELETE /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:13:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5866bc61-5cb3-4219-b253-2916638c3156 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee751ecb0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5866bc61-5cb3-4219-b253-2916638c3156 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 200 len: 344 microversion: 2.1 time: 0.066454 Apr 12 16:13:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 248/753] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:13:58 2023] GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1326442338", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "89a33fcd-81e9-4815-8644-d9b33ceb236b"}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:13:58 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] validate_networks() for [('89a33fcd-81e9-4815-8644-d9b33ceb236b', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: c307e623-c546-487f-ac16-5eb24d088e8a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:13:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] HTTP exception thrown: Instance c307e623-c546-487f-ac16-5eb24d088e8a could not be found. Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Request method failure captured: Apr 12 16:13:59 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a HTTP/1.1 Apr 12 16:13:59 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:13:59 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:13:59 user devstack@n-api.service[61658]: Connection: close Apr 12 16:13:59 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:13:59 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:13:59 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:13:59 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:13:59 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtcmd6lrI1_y6kltoiTKUxlS84fOEoD3D_DMU3lXZ9aTG2fU7qF_rLi18JOWOnyXyZ-meM48TquiIVE18bESfKDitACjntkzWma1E1jZTMp7gm9UqlNRDRy3C-4TZwEfLd1Rg_jm0KiJ6sznFDkVYjL4lP3ttEJtCfd_VCdlj6pCNEo Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Project-Id: a77372a5e83c4fc882b0a0b0eea46f06 Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Project-Name: tempest-TestStampPattern-1256589700 Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Tenant: tempest-TestStampPattern-1256589700 Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Tenant-Id: a77372a5e83c4fc882b0a0b0eea46f06 Apr 12 16:13:59 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TestStampPattern-1256589700 Apr 12 16:13:59 user devstack@n-api.service[61658]: X-User: tempest-TestStampPattern-1256589700-project-member Apr 12 16:13:59 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:13:59 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:13:59 user devstack@n-api.service[61658]: X-User-Id: 5e0ffc0972674609b17fe2780751dfc5 Apr 12 16:13:59 user devstack@n-api.service[61658]: X-User-Name: tempest-TestStampPattern-1256589700-project-member Apr 12 16:13:59 user devstack@n-api.service[61658]: method: > Apr 12 16:13:59 user devstack@n-api.service[61658]: exception: Instance c307e623-c546-487f-ac16-5eb24d088e8a could not be found. Apr 12 16:13:59 user devstack@n-api.service[61658]: action_args: {'id': 'c307e623-c546-487f-ac16-5eb24d088e8a'} Apr 12 16:13:59 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c307e623-c546-487f-ac16-5eb24d088e8a could not be found. Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c307e623-c546-487f-ac16-5eb24d088e8a could not be found. Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c307e623-c546-487f-ac16-5eb24d088e8a could not be found. Apr 12 16:13:59 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Returning 404 to user: Instance c307e623-c546-487f-ac16-5eb24d088e8a could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:13:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e02abd58-bbfb-418b-b61c-ebd645765ea7 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a" status: 404 len: 111 microversion: 2.1 time: 0.052557 Apr 12 16:13:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 254/754] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:59 2023] GET /compute/v2.1/servers/c307e623-c546-487f-ac16-5eb24d088e8a => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:13:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-bb141225-960c-4946-ab32-69e665048584 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee756f0a0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:13:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-bb141225-960c-4946-ab32-69e665048584 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 200 len: 344 microversion: 2.1 time: 0.096345 Apr 12 16:13:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 249/755] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:13:59 2023] GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 344 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Getting quotas for project 280a9a56afca4ce591faca7a94eca4b2. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Getting quotas for user 38c60e84c47047e2886220f2ef54391d and project 280a9a56afca4ce591faca7a94eca4b2. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:13:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:13:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f07e1b0d-e740-46eb-af87-8d455c4c9b84 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.643969 Apr 12 16:13:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 253/756] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:13:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7b88b1ea-2af4-444d-833c-c54b0df9615b tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7b88b1ea-2af4-444d-833c-c54b0df9615b tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:13:59 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-7b88b1ea-2af4-444d-833c-c54b0df9615b tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:13:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7b88b1ea-2af4-444d-833c-c54b0df9615b tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" status: 200 len: 1211 microversion: 2.1 time: 0.087014 Apr 12 16:13:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 255/757] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:13:59 2023] GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1725b6c9-848d-4643-8976-1ebfe841afa5 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee7633400>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-1725b6c9-848d-4643-8976-1ebfe841afa5 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] HTTP exception thrown: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1725b6c9-848d-4643-8976-1ebfe841afa5 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Request method failure captured: Apr 12 16:14:00 user devstack@n-api.service[61659]: request: GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 HTTP/1.1 Apr 12 16:14:00 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:14:00 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:14:00 user devstack@n-api.service[61659]: Connection: close Apr 12 16:14:00 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:14:00 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:14:00 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:14:00 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:14:00 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNti_v3NJB30pfmioijNZwHpY05i9-e2xP64lABlbgut-AZ6kSqbMD0939xJpWXUXRCzUoxQeyGfGY9gdKHT86NOS0qZqhOPPj13i4jeEfWVp66z7NuHWcwnk3BpEQxR0Tx0otWrFCbkJAxIACeD5xlDHqnyGs5biSdecUXWmMxOK8JY Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Project-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Tenant-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:14:00 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61659]: X-User: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:14:00 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:14:00 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:14:00 user devstack@n-api.service[61659]: X-User-Id: ed0447936c7d40c1bb8a847d5b0219ca Apr 12 16:14:00 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:14:00 user devstack@n-api.service[61659]: method: Apr 12 16:14:00 user devstack@n-api.service[61659]: exception: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61659]: action_args: {'id': '5274a0c4-0f77-4d97-adc7-ea20b41e90b0'} Apr 12 16:14:00 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. (HTTP 404) (Request-ID: req-6d46987b-5589-4b29-9a92-5f59f1d0cebe) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1725b6c9-848d-4643-8976-1ebfe841afa5 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Returning 404 to user: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:14:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1725b6c9-848d-4643-8976-1ebfe841afa5 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 404 len: 109 microversion: 2.1 time: 0.045677 Apr 12 16:14:00 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 250/758] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:14:00 2023] GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:14:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-b690b03e-2015-4446-93a2-0d6b957d6bef tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee7bcfb50>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-b690b03e-2015-4446-93a2-0d6b957d6bef tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] HTTP exception thrown: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-b690b03e-2015-4446-93a2-0d6b957d6bef tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Request method failure captured: Apr 12 16:14:00 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 HTTP/1.1 Apr 12 16:14:00 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:14:00 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:14:00 user devstack@n-api.service[61657]: Connection: close Apr 12 16:14:00 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:14:00 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:14:00 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:14:00 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:14:00 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNti_v3NJB30pfmioijNZwHpY05i9-e2xP64lABlbgut-AZ6kSqbMD0939xJpWXUXRCzUoxQeyGfGY9gdKHT86NOS0qZqhOPPj13i4jeEfWVp66z7NuHWcwnk3BpEQxR0Tx0otWrFCbkJAxIACeD5xlDHqnyGs5biSdecUXWmMxOK8JY Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Project-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Tenant-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:14:00 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61657]: X-User: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:14:00 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:14:00 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:14:00 user devstack@n-api.service[61657]: X-User-Id: ed0447936c7d40c1bb8a847d5b0219ca Apr 12 16:14:00 user devstack@n-api.service[61657]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:14:00 user devstack@n-api.service[61657]: method: Apr 12 16:14:00 user devstack@n-api.service[61657]: exception: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61657]: action_args: {'id': '5274a0c4-0f77-4d97-adc7-ea20b41e90b0'} Apr 12 16:14:00 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. (HTTP 404) (Request-ID: req-6f02ddcf-7743-493c-b619-185afcb940a4) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-b690b03e-2015-4446-93a2-0d6b957d6bef tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Returning 404 to user: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:14:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-b690b03e-2015-4446-93a2-0d6b957d6bef tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 404 len: 109 microversion: 2.1 time: 0.050828 Apr 12 16:14:00 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 254/759] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:14:00 2023] DELETE /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:14:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c6ca4106-cdd1-4afa-8e2c-404f3ebb1736 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Calling method '.version_select at 0x7fdee7cdc820>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-c6ca4106-cdd1-4afa-8e2c-404f3ebb1736 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] HTTP exception thrown: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c6ca4106-cdd1-4afa-8e2c-404f3ebb1736 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Request method failure captured: Apr 12 16:14:00 user devstack@n-api.service[61658]: request: GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 HTTP/1.1 Apr 12 16:14:00 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:14:00 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:14:00 user devstack@n-api.service[61658]: Connection: close Apr 12 16:14:00 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:14:00 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:14:00 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:14:00 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:14:00 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNti_v3NJB30pfmioijNZwHpY05i9-e2xP64lABlbgut-AZ6kSqbMD0939xJpWXUXRCzUoxQeyGfGY9gdKHT86NOS0qZqhOPPj13i4jeEfWVp66z7NuHWcwnk3BpEQxR0Tx0otWrFCbkJAxIACeD5xlDHqnyGs5biSdecUXWmMxOK8JY Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Project-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/355617bc09b342f49b8ce2b7e917bc82"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Tenant-Id: 355617bc09b342f49b8ce2b7e917bc82 Apr 12 16:14:00 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173144106 Apr 12 16:14:00 user devstack@n-api.service[61658]: X-User: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:14:00 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:14:00 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:14:00 user devstack@n-api.service[61658]: X-User-Id: ed0447936c7d40c1bb8a847d5b0219ca Apr 12 16:14:00 user devstack@n-api.service[61658]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173144106-project-member Apr 12 16:14:00 user devstack@n-api.service[61658]: method: Apr 12 16:14:00 user devstack@n-api.service[61658]: exception: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61658]: action_args: {'id': '5274a0c4-0f77-4d97-adc7-ea20b41e90b0'} Apr 12 16:14:00 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. (HTTP 404) (Request-ID: req-4fd5e772-fc6b-474a-b347-43d45a0a994a) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. Apr 12 16:14:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c6ca4106-cdd1-4afa-8e2c-404f3ebb1736 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] Returning 404 to user: Volume 5274a0c4-0f77-4d97-adc7-ea20b41e90b0 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:14:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c6ca4106-cdd1-4afa-8e2c-404f3ebb1736 tempest-VolumesSnapshotsTestJSON-1173144106 tempest-VolumesSnapshotsTestJSON-1173144106-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0" status: 404 len: 109 microversion: 2.1 time: 0.046294 Apr 12 16:14:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 256/760] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:14:00 2023] GET /compute/v2.1/os-volumes/5274a0c4-0f77-4d97-adc7-ea20b41e90b0 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:14:03 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e", "tag": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:03 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] Creating event network-changed:adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e on user Apr 12 16:14:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-aa2f0061-e87e-457c-945d-70e0c2d39cd5 req-ce197e99-a35d-4350-ad6c-254e9f457f38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044317 Apr 12 16:14:03 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 251/761] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] HTTP exception thrown: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab is not attached to volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4 Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Request method failure captured: Apr 12 16:14:03 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments/ba5930f5-72be-4d2a-9ebd-47eae870a1e4 HTTP/1.1 Apr 12 16:14:03 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:14:03 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:14:03 user devstack@n-api.service[61657]: Connection: close Apr 12 16:14:03 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:14:03 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:14:03 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:14:03 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:14:03 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtcmd6lrI1_y6kltoiTKUxlS84fOEoD3D_DMU3lXZ9aTG2fU7qF_rLi18JOWOnyXyZ-meM48TquiIVE18bESfKDitACjntkzWma1E1jZTMp7gm9UqlNRDRy3C-4TZwEfLd1Rg_jm0KiJ6sznFDkVYjL4lP3ttEJtCfd_VCdlj6pCNEo Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Project-Id: a77372a5e83c4fc882b0a0b0eea46f06 Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestStampPattern-1256589700 Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Tenant: tempest-TestStampPattern-1256589700 Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Tenant-Id: a77372a5e83c4fc882b0a0b0eea46f06 Apr 12 16:14:03 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestStampPattern-1256589700 Apr 12 16:14:03 user devstack@n-api.service[61657]: X-User: tempest-TestStampPattern-1256589700-project-member Apr 12 16:14:03 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:14:03 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:14:03 user devstack@n-api.service[61657]: X-User-Id: 5e0ffc0972674609b17fe2780751dfc5 Apr 12 16:14:03 user devstack@n-api.service[61657]: X-User-Name: tempest-TestStampPattern-1256589700-project-member Apr 12 16:14:03 user devstack@n-api.service[61657]: method: > Apr 12 16:14:03 user devstack@n-api.service[61657]: exception: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab is not attached to volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4 Apr 12 16:14:03 user devstack@n-api.service[61657]: action_args: {'server_id': '78b6940a-f97a-4535-8973-3c2a5befbbab', 'id': 'ba5930f5-72be-4d2a-9ebd-47eae870a1e4'} Apr 12 16:14:03 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ba5930f5-72be-4d2a-9ebd-47eae870a1e4. Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab is not attached to volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4 Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab is not attached to volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4 Apr 12 16:14:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:14:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Returning 404 to user: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab is not attached to volume ba5930f5-72be-4d2a-9ebd-47eae870a1e4 {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:14:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-558025ba-12c2-4783-b9ba-4d90bb4ba36f tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments/ba5930f5-72be-4d2a-9ebd-47eae870a1e4" status: 404 len: 154 microversion: 2.1 time: 0.111866 Apr 12 16:14:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 255/762] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:14:03 2023] DELETE /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab/os-volume_attachments/ba5930f5-72be-4d2a-9ebd-47eae870a1e4 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:04 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:14:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-fbc004da-fd5e-4066-894a-101820513765 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab" status: 204 len: 0 microversion: 2.1 time: 0.154039 Apr 12 16:14:04 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 257/763] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:14:04 2023] DELETE /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:05 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e0ffc0972674609b17fe2780751dfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a77372a5e83c4fc882b0a0b0eea46f06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-421b46a5-a15b-4c6b-988e-49328f3ac5d6 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab" status: 200 len: 1663 microversion: 2.1 time: 0.299904 Apr 12 16:14:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 252/764] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:04 2023] GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab => generated 1663 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] Creating event network-changed:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:14:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-92b698b5-8ef2-43ca-92d6-065c2baa5231 req-68de5a00-0f30-434c-8610-f406d619e073 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050584 Apr 12 16:14:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 256/765] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:05 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "name": "network-vif-unplugged", "status": "completed", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] Creating event network-vif-unplugged:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:14:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-a95e0d96-2cc0-42ec-9909-235a3dc2904b req-787c4bea-88f7-4364-abac-716864a8eed1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047284 Apr 12 16:14:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 258/766] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-3bfb8fe8-d81e-46a9-8a78-1a5fc47f157a req-9583490d-ff86-43be-b734-19f8bf2ef1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "name": "network-vif-deleted", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3bfb8fe8-d81e-46a9-8a78-1a5fc47f157a req-9583490d-ff86-43be-b734-19f8bf2ef1f6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3bfb8fe8-d81e-46a9-8a78-1a5fc47f157a req-9583490d-ff86-43be-b734-19f8bf2ef1f6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3bfb8fe8-d81e-46a9-8a78-1a5fc47f157a req-9583490d-ff86-43be-b734-19f8bf2ef1f6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3bfb8fe8-d81e-46a9-8a78-1a5fc47f157a req-9583490d-ff86-43be-b734-19f8bf2ef1f6 service nova] Creating event network-vif-deleted:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:14:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-3bfb8fe8-d81e-46a9-8a78-1a5fc47f157a req-9583490d-ff86-43be-b734-19f8bf2ef1f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028343 Apr 12 16:14:07 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 253/767] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:07 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78b6940a-f97a-4535-8973-3c2a5befbbab", "name": "network-vif-plugged", "status": "completed", "tag": "db313dea-d267-434a-96bb-d099b17ab2d4"}, {"server_uuid": "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e", "name": "network-vif-plugged", "status": "completed", "tag": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de"}, {"server_uuid": "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e", "name": "network-vif-plugged", "status": "completed", "tag": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Creating event network-vif-plugged:db313dea-d267-434a-96bb-d099b17ab2d4 for instance 78b6940a-f97a-4535-8973-3c2a5befbbab on user Apr 12 16:14:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Creating event network-vif-plugged:adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e on user Apr 12 16:14:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] Creating event network-vif-plugged:adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e on user Apr 12 16:14:07 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-72307bd5-d146-4539-801b-a21c6158b9c5 req-6b9da292-6145-44a3-8943-b06a6b41f12a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035569 Apr 12 16:14:07 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 257/768] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:07 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: 84683344-2893-4446-90ae-e64cd799eb20] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] HTTP exception thrown: Instance 84683344-2893-4446-90ae-e64cd799eb20 could not be found. Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Request method failure captured: Apr 12 16:14:11 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 HTTP/1.1 Apr 12 16:14:11 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:14:11 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:14:11 user devstack@n-api.service[61658]: Connection: close Apr 12 16:14:11 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:14:11 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:14:11 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:14:11 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:14:11 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtdrPOEzq3NajGVio9y9Dtg1Ox8thkhzem7Nq1fBGQAzfZuOtOYBI1KDTxCByAg-s35vdnS3hlpPPN-tTXWeYvt5dhklovFZmL6sE_ooacxs7YWNGmJkg48xgOaF3ibSfUnWe2Px0E76EwM6IqXotkdqINcSLchI5RcFB-9TdNnFYL0 Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Project-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Project-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/236b9e609eb44071bc88971bff96931e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Tenant: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Tenant-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:14:11 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:14:11 user devstack@n-api.service[61658]: X-User: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:14:11 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:14:11 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:14:11 user devstack@n-api.service[61658]: X-User-Id: 16a68fa3490940ebaebc8d4ca5746f6e Apr 12 16:14:11 user devstack@n-api.service[61658]: X-User-Name: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:14:11 user devstack@n-api.service[61658]: method: > Apr 12 16:14:11 user devstack@n-api.service[61658]: exception: Instance 84683344-2893-4446-90ae-e64cd799eb20 could not be found. Apr 12 16:14:11 user devstack@n-api.service[61658]: action_args: {'id': '84683344-2893-4446-90ae-e64cd799eb20'} Apr 12 16:14:11 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84683344-2893-4446-90ae-e64cd799eb20 could not be found. Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84683344-2893-4446-90ae-e64cd799eb20 could not be found. Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84683344-2893-4446-90ae-e64cd799eb20 could not be found. Apr 12 16:14:11 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:14:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Returning 404 to user: Instance 84683344-2893-4446-90ae-e64cd799eb20 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:14:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-99d5ff6f-33e8-45ae-b13c-3c7bef3ae5e6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20" status: 404 len: 111 microversion: 2.1 time: 0.040598 Apr 12 16:14:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 259/769] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:11 2023] GET /compute/v2.1/servers/84683344-2893-4446-90ae-e64cd799eb20 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:14:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0e480d1b-63fa-40a4-b374-7f94acf87e19 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '.version_select at 0x7fdee751f1c0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-0e480d1b-63fa-40a4-b374-7f94acf87e19 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1145355827" status: 202 len: 0 microversion: 2.1 time: 0.028864 Apr 12 16:14:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 254/770] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 16:14:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1145355827 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:14:14 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:14 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=12 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d3d587d8-4aaf-4133-8d6e-3ac504aeb3bc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'create', calling method: .version_select at 0x7fdee7a77e20>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1912647637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbxR7XOwk113oWUkXlckv3xW8Ml31qZ6CdwMA2FLaXgBX+cAx40ag2FfMVKhGuA7H5T7OmtJlyS1451of3/3trw1T7Q3yghc0E0SJ2p2NDvcjF3/krMejZ/FZS/hV4u4g=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:14 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-d3d587d8-4aaf-4133-8d6e-3ac504aeb3bc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for project 236b9e609eb44071bc88971bff96931e. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:14:14 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-d3d587d8-4aaf-4133-8d6e-3ac504aeb3bc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for user 16a68fa3490940ebaebc8d4ca5746f6e and project 236b9e609eb44071bc88971bff96931e. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:14:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d3d587d8-4aaf-4133-8d6e-3ac504aeb3bc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052732 Apr 12 16:14:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 258/771] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:14:14 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:14:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1831226458", "imageRef": "f2a10ad0-dd56-4297-aed7-ce5d72ea953b", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1912647637", "networks": [{"uuid": "58f92787-e3b6-4fd3-bd75-7169f1a36651"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:14 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] validate_networks() for [('58f92787-e3b6-4fd3-bd75-7169f1a36651', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for project 236b9e609eb44071bc88971bff96931e. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Getting quotas for user 16a68fa3490940ebaebc8d4ca5746f6e and project 236b9e609eb44071bc88971bff96931e. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:14:15 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f2a10ad0-dd56-4297-aed7-ce5d72ea953b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:14:15 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f63bb32e-8c68-4c53-b2f2-2d7a0a74f5c8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.903845 Apr 12 16:14:15 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 260/772] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:14:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:14:15 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-efbdc28b-35b4-4e4b-abe1-24e1e0841769 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:15 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-efbdc28b-35b4-4e4b-abe1-24e1e0841769 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:15 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-efbdc28b-35b4-4e4b-abe1-24e1e0841769 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-efbdc28b-35b4-4e4b-abe1-24e1e0841769 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1253 microversion: 2.1 time: 0.185945 Apr 12 16:14:15 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 255/773] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:15 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1253 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:18 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=19 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] Creating event network-changed:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:14:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-81873284-0fc2-4344-a284-90e050149f35 req-7cf7e2a2-262f-49b7-8895-a701271dc58e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033755 Apr 12 16:14:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 259/774] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-plugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] Creating event network-vif-plugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:14:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-9c0dc2ea-fef1-4ef4-93d0-fb27e92c7eb5 req-a914079f-6f74-4839-b505-da6606b64cd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058750 Apr 12 16:14:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 261/775] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:21 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:21 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=11 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:21 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Going to try to start instance {{(pid=61659) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 16:14:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1aa6f02b-e438-46d9-9da8-a550e1f74e6a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action" status: 202 len: 0 microversion: 2.1 time: 0.133729 Apr 12 16:14:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 256/776] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:14:21 2023] POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=7 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:21 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:21 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a8984830-5aa9-49c3-9ad5-34f7937cda16 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1698 microversion: 2.1 time: 0.299548 Apr 12 16:14:21 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 260/777] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:21 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1698 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:23 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-plugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] Creating event network-vif-plugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:14:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-786a6dcd-414c-454a-85f8-40ae399834ff req-b6350789-ef23-43d0-bdaf-9ee166bcc5d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030965 Apr 12 16:14:23 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 262/778] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:25 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:25 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-981a1a95-c1b0-4bb7-aeca-54794b7ef237 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057850 Apr 12 16:14:25 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 257/779] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:14:25 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:25 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:14:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ecad32ac-b31d-4ef9-a008-fa9aa860fd55 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 204 len: 0 microversion: 2.1 time: 0.153393 Apr 12 16:14:25 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 261/780] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:14:25 2023] DELETE /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:26 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-67547bd6-a666-49f1-948b-b5618779857d tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 200 len: 1679 microversion: 2.1 time: 0.391317 Apr 12 16:14:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 263/781] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:25 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 1679 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-unplugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] Creating event network-vif-unplugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:14:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-b10df85a-24c8-4e97-8c4d-aa1e1692eccd req-a3467b27-b87e-46af-b396-95011978cd19 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.477662 Apr 12 16:14:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 258/782] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:14:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e2f81833-1a52-4208-887e-48e266371ea0 req-60723866-d08d-4c61-83f8-78dfa4061724 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096973 Apr 12 16:14:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 262/783] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:28 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-plugged", "status": "completed", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] Creating event network-vif-plugged:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:14:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-30948bbc-2c0f-48a8-b424-8dc29855d3bb req-d8ea7c17-a9c6-43d9-9665-b8627802ca59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037169 Apr 12 16:14:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 264/784] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:14:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-9ab1f25d-8ab0-4587-8b00-9fa760dcf623 req-fe220ba2-d815-430e-b92f-5936e3f1dc63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053470 Apr 12 16:14:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 259/785] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:31 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-941daf8b-7f2c-4540-8c35-88a80032748c req-14ff20eb-a06e-4571-a148-e00d87bd7514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f641c6b-b508-42a7-ae98-c2bfb841d798", "name": "network-vif-deleted", "tag": "746786a9-c889-4ece-bc5e-a905bf8deb5c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-941daf8b-7f2c-4540-8c35-88a80032748c req-14ff20eb-a06e-4571-a148-e00d87bd7514 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-941daf8b-7f2c-4540-8c35-88a80032748c req-14ff20eb-a06e-4571-a148-e00d87bd7514 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-941daf8b-7f2c-4540-8c35-88a80032748c req-14ff20eb-a06e-4571-a148-e00d87bd7514 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-941daf8b-7f2c-4540-8c35-88a80032748c req-14ff20eb-a06e-4571-a148-e00d87bd7514 service nova] Creating event network-vif-deleted:746786a9-c889-4ece-bc5e-a905bf8deb5c for instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 on user Apr 12 16:14:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-941daf8b-7f2c-4540-8c35-88a80032748c req-14ff20eb-a06e-4571-a148-e00d87bd7514 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052218 Apr 12 16:14:31 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 263/786] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:36 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:36 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-83ecaeec-9814-4e68-97ff-0941d1de1540 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a/action" status: 202 len: 0 microversion: 2.87 time: 0.097348 Apr 12 16:14:36 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 265/787] 10.0.0.210 () {66 vars in 1396 bytes} [Wed Apr 12 16:14:36 2023] POST /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:36 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d2b18b51-95cc-4c56-93b0-65237365efdf tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 200 len: 1763 microversion: 2.87 time: 0.190715 Apr 12 16:14:36 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 260/788] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:14:36 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 1763 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:14:37 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-unplugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] Creating event network-vif-unplugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:14:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3eef3e48-f26e-4638-9a72-0f9d890131b9 req-3e25a7af-eb95-4988-9246-31b8022bb5ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038848 Apr 12 16:14:37 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 264/789] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:39 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:14:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-1b386072-3f8f-4fe2-9142-1af5b08ed80d req-01b294c5-495b-4615-bd1c-b450ddb5f179 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 Apr 12 16:14:39 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 261/790] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6e82e41f-a209-4c51-89b5-340942e00990 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Action: 'create', calling method: .version_select at 0x7fdee7613250>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-437348076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+FpbR8FK82hCEPJ5HMQ8owWEJRGyodg69j5jSQV/QhgdEnkk4eYIy7X1tEJsjea4X8jfMn9W0N1l8a7XMKl5DRaLYt49U8Vr9yiskiXDGQVl0iBNmRtOG0NsqYt2si5A=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:40 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-6e82e41f-a209-4c51-89b5-340942e00990 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting quotas for project 29d8082517724895a2027594f440071d. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:14:40 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-6e82e41f-a209-4c51-89b5-340942e00990 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting quotas for user 3823da50be004112aaa5ee35b724c6df and project 29d8082517724895a2027594f440071d. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:14:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6e82e41f-a209-4c51-89b5-340942e00990 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.295826 Apr 12 16:14:40 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 266/791] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:14:39 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:41 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-32f748c8-ee78-436e-b174-5609115b4d81 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976" status: 200 len: 1539 microversion: 2.1 time: 0.255188 Apr 12 16:14:41 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 265/792] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:40 2023] GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976 => generated 1539 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:41 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-491760148", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-437348076", "security_groups": [{"name": "tempest-secgroup-smoke-976650344"}], "networks": [{"uuid": "9c134a59-09c8-44dc-b4c7-3bb522d3f948"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:41 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] validate_networks() for [('9c134a59-09c8-44dc-b4c7-3bb522d3f948', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:14:41 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}, {"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:14:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:14:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-e3b1b41e-f61e-403e-be7f-a5815540736a req-e98f27c0-fc9b-4368-8a16-78afe1926187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043742 Apr 12 16:14:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 267/793] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:41 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting quotas for project 29d8082517724895a2027594f440071d. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Getting quotas for user 3823da50be004112aaa5ee35b724c6df and project 29d8082517724895a2027594f440071d. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:14:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:14:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6095bc66-af1b-412a-ab92-dbe38ad854b6 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.773808 Apr 12 16:14:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 262/794] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:14:41 2023] POST /compute/v2.1/servers => generated 403 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:14:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-6d82a0f2-2251-4e9c-a60b-b033ee86995a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-6d82a0f2-2251-4e9c-a60b-b033ee86995a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:42 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-6d82a0f2-2251-4e9c-a60b-b033ee86995a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3823da50be004112aaa5ee35b724c6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d8082517724895a2027594f440071d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-6d82a0f2-2251-4e9c-a60b-b033ee86995a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5" status: 200 len: 1255 microversion: 2.1 time: 0.095304 Apr 12 16:14:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 266/795] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:42 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => generated 1255 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:45 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:45 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] Creating event network-changed:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:14:45 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-f8543318-1b53-492f-a171-2ea0777fab01 req-311d2b0a-495b-41ba-9f19-2ec2ae43925a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034541 Apr 12 16:14:45 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 268/796] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:14:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "name": "network-vif-plugged", "status": "completed", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] Creating event network-vif-plugged:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:14:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-3234d0d8-218e-4a90-b707-1abd579e79e1 req-c3639adc-765c-44c6-96a2-c964cb83a790 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036166 Apr 12 16:14:47 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 263/797] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "name": "network-vif-plugged", "status": "completed", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:14:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] Creating event network-vif-plugged:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:14:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-c4d833e4-9354-4b80-b880-3fa8f968f80f req-cde9a06c-9cfc-42f2-9504-1dde265cb499 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043257 Apr 12 16:14:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 269/798] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:14:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:14:49 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:14:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fe965293-6eb8-4873-a109-765f21b48eb5 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" status: 200 len: 1494 microversion: 2.1 time: 0.223684 Apr 12 16:14:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 267/799] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:49 2023] GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => generated 1494 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] [instance: 78b6940a-f97a-4535-8973-3c2a5befbbab] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] HTTP exception thrown: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab could not be found. Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Request method failure captured: Apr 12 16:14:55 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab HTTP/1.1 Apr 12 16:14:55 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:14:55 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:14:55 user devstack@n-api.service[61659]: Connection: close Apr 12 16:14:55 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:14:55 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:14:55 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:14:55 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:14:55 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtcmd6lrI1_y6kltoiTKUxlS84fOEoD3D_DMU3lXZ9aTG2fU7qF_rLi18JOWOnyXyZ-meM48TquiIVE18bESfKDitACjntkzWma1E1jZTMp7gm9UqlNRDRy3C-4TZwEfLd1Rg_jm0KiJ6sznFDkVYjL4lP3ttEJtCfd_VCdlj6pCNEo Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Project-Id: a77372a5e83c4fc882b0a0b0eea46f06 Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestStampPattern-1256589700 Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a77372a5e83c4fc882b0a0b0eea46f06"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Tenant: tempest-TestStampPattern-1256589700 Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Tenant-Id: a77372a5e83c4fc882b0a0b0eea46f06 Apr 12 16:14:55 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestStampPattern-1256589700 Apr 12 16:14:55 user devstack@n-api.service[61659]: X-User: tempest-TestStampPattern-1256589700-project-member Apr 12 16:14:55 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:14:55 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:14:55 user devstack@n-api.service[61659]: X-User-Id: 5e0ffc0972674609b17fe2780751dfc5 Apr 12 16:14:55 user devstack@n-api.service[61659]: X-User-Name: tempest-TestStampPattern-1256589700-project-member Apr 12 16:14:55 user devstack@n-api.service[61659]: method: > Apr 12 16:14:55 user devstack@n-api.service[61659]: exception: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab could not be found. Apr 12 16:14:55 user devstack@n-api.service[61659]: action_args: {'id': '78b6940a-f97a-4535-8973-3c2a5befbbab'} Apr 12 16:14:55 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab could not be found. Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab could not be found. Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab could not be found. Apr 12 16:14:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:14:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Returning 404 to user: Instance 78b6940a-f97a-4535-8973-3c2a5befbbab could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:14:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-9e3f7e7b-320d-4d43-a417-078105080438 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab" status: 404 len: 111 microversion: 2.1 time: 0.039574 Apr 12 16:14:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 264/800] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:14:55 2023] GET /compute/v2.1/servers/78b6940a-f97a-4535-8973-3c2a5befbbab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:14:57 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:14:57 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-af52ea9f-bed7-471c-aa71-dccd607d6a72 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] Calling method '.version_select at 0x7fdee7610e50>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:14:57 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-af52ea9f-bed7-471c-aa71-dccd607d6a72 tempest-TestStampPattern-1256589700 tempest-TestStampPattern-1256589700-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1321754823" status: 202 len: 0 microversion: 2.1 time: 0.079257 Apr 12 16:14:57 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 270/801] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:14:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1321754823 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=5 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:06 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-bb2a6dd3-abe1-426c-8a1d-2c69955f46d8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1536 microversion: 2.1 time: 0.182672 Apr 12 16:15:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 268/802] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:05 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1536 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:12 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d843ca47-288c-46df-8573-66856baee03b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1702 microversion: 2.1 time: 0.231718 Apr 12 16:15:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 265/803] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:11 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1702 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 7f641c6b-b508-42a7-ae98-c2bfb841d798] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] HTTP exception thrown: Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 could not be found. Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Request method failure captured: Apr 12 16:15:16 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 HTTP/1.1 Apr 12 16:15:16 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:15:16 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:15:16 user devstack@n-api.service[61658]: Connection: close Apr 12 16:15:16 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:15:16 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:15:16 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:15:16 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:15:16 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVUIREaEpSCxaDHhRTy1-3vG98zUQQrkdSdA21f2O72s3N3rIDmLgBOdKtY1raaQOA2q8xobAID4T92RRWByg3TQMewePmiVUfKjOk4N3mk2Chaqhzu21Gl8iq5G39Tfr8LyTLfxMsGVguI0Q0Es6MN889SFcfwJK58-JrBG9wNTTI Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Project-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Tenant-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:15:16 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:15:16 user devstack@n-api.service[61658]: X-User: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:15:16 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:15:16 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:15:16 user devstack@n-api.service[61658]: X-User-Id: 880266e3fa4d4dd889648c10208a1f8e Apr 12 16:15:16 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:15:16 user devstack@n-api.service[61658]: method: > Apr 12 16:15:16 user devstack@n-api.service[61658]: exception: Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 could not be found. Apr 12 16:15:16 user devstack@n-api.service[61658]: action_args: {'id': '7f641c6b-b508-42a7-ae98-c2bfb841d798'} Apr 12 16:15:16 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 could not be found. Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 could not be found. Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 could not be found. Apr 12 16:15:16 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:15:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Returning 404 to user: Instance 7f641c6b-b508-42a7-ae98-c2bfb841d798 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:15:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-cf6d67a0-db25-430c-9623-ebe6aa955377 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798" status: 404 len: 111 microversion: 2.1 time: 0.057994 Apr 12 16:15:16 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 271/804] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:16 2023] GET /compute/v2.1/servers/7f641c6b-b508-42a7-ae98-c2bfb841d798 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:15:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-dcee2f7e-4b10-4d7b-bb64-41e0b0134f8a tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '.version_select at 0x7fdee76b1750>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:16 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:16 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-dcee2f7e-4b10-4d7b-bb64-41e0b0134f8a tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217848071" status: 202 len: 0 microversion: 2.1 time: 0.030993 Apr 12 16:15:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 269/805] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 16:15:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217848071 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:21 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:15:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8b788c9f-5a1e-4355-9bc3-b3c35e002500 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872" status: 204 len: 0 microversion: 2.1 time: 0.344510 Apr 12 16:15:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 266/806] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:15:21 2023] DELETE /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:21 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-unplugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] Creating event network-vif-unplugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 16:15:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-bd5b1caa-1004-4df4-9605-1928b5e707de req-150852b1-00a6-4701-ba5b-28a0ffe649b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036087 Apr 12 16:15:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 270/807] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:22 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-afa8d793-44ae-4823-a3fb-fdb098c020e8 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872" status: 200 len: 1495 microversion: 2.1 time: 0.391160 Apr 12 16:15:22 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 272/808] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:21 2023] GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 => generated 1495 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:15:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-deleted", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] Creating event network-vif-deleted:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 16:15:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-b9e50020-6577-4ef5-b6a7-79e3e069b1c5 req-5a09766e-7d12-4039-8e1b-929cebc73286 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030443 Apr 12 16:15:23 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 267/809] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:24 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "473a30c4-5aa4-481c-8859-fda815d14872", "name": "network-vif-plugged", "status": "completed", "tag": "556d7c96-2d40-43fc-83fe-2059479a5265"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] Creating event network-vif-plugged:556d7c96-2d40-43fc-83fe-2059479a5265 for instance 473a30c4-5aa4-481c-8859-fda815d14872 on user Apr 12 16:15:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-0004423f-668f-4c29-929f-74fabaceabe5 req-a8c15c93-b78f-45e9-8501-44a0256dc059 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030405 Apr 12 16:15:24 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 271/810] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-156970536", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "4706b679-046d-4609-9320-396658940205", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1439244b-8287-4bba-a88c-99d4b498cccd"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] validate_networks() for [('1439244b-8287-4bba-a88c-99d4b498cccd', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for user 7054687447fc42339e9046ced4915890 and project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:15:25 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4706b679-046d-4609-9320-396658940205',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:15:25 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-eb506e4d-cac1-4b9e-97c5-226f6fb819b2 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.631180 Apr 12 16:15:25 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 273/811] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:15:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:15:25 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-3c03ab43-e33b-4852-b89f-e7cafed1a78c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:25 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-3c03ab43-e33b-4852-b89f-e7cafed1a78c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:25 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-3c03ab43-e33b-4852-b89f-e7cafed1a78c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:25 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-3c03ab43-e33b-4852-b89f-e7cafed1a78c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 200 len: 1051 microversion: 2.1 time: 0.072993 Apr 12 16:15:25 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 268/812] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:25 2023] GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 1051 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:27 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7f78c3c5-d309-4b80-9604-8addb0456e0f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 200 len: 1769 microversion: 2.87 time: 0.221136 Apr 12 16:15:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 272/813] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:15:27 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 1769 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:15:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59", "tag": "e3207e92-f3c0-4115-bda1-f02903827226"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] Creating event network-changed:e3207e92-f3c0-4115-bda1-f02903827226 for instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 on user Apr 12 16:15:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-8a4bee51-ae63-4a49-a71e-bf420d7d3c1a req-674cace5-0682-4d41-9997-38fb7b001bcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038320 Apr 12 16:15:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 274/814] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:32 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3823da50be004112aaa5ee35b724c6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d8082517724895a2027594f440071d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a1261801-b9c0-4853-aa15-1bb230fa6ea1 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5" status: 200 len: 1566 microversion: 2.1 time: 0.153975 Apr 12 16:15:32 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 269/815] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:32 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=10 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=12 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59", "name": "network-vif-plugged", "status": "completed", "tag": "e3207e92-f3c0-4115-bda1-f02903827226"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] Creating event network-vif-plugged:e3207e92-f3c0-4115-bda1-f02903827226 for instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 on user Apr 12 16:15:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-5f589e6d-c00e-41bf-a120-629c100f4973 req-a588587e-366f-4ae7-8b82-0b31c1fbca8b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102442 Apr 12 16:15:41 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 275/816] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c4e314d2-95c9-4b43-a7dc-027c4ea47fbf tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.301360 Apr 12 16:15:41 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 273/817] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:15:41 2023] GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976/os-interface => generated 283 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] Creating event network-changed:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:15:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-facc86c6-b14e-4b82-8d6f-90ab6b505e24 req-2cc68d20-7c32-4944-b2d4-9e7af0223490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103507 Apr 12 16:15:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 270/818] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59", "name": "network-vif-plugged", "status": "completed", "tag": "e3207e92-f3c0-4115-bda1-f02903827226"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] Creating event network-vif-plugged:e3207e92-f3c0-4115-bda1-f02903827226 for instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 on user Apr 12 16:15:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-40fc0ac6-9c07-49d2-b857-e6d45582fab6 req-395ef9f8-f2c7-496f-999e-b0df945060a7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048352 Apr 12 16:15:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 276/819] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1742194488", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "e6694358-e361-4952-b859-93755c11721e"}], "security_groups": [{"name": "tempest-securitygroup--384785848"}], "key_name": "tempest-keypair-1923467613", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "b5a801df-b37e-4132-8465-d4011ca47775", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] validate_networks() for [('e6694358-e361-4952-b859-93755c11721e', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for user 1a699b3ba8304eadb8a53d465ea340cf and project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:15:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5a801df-b37e-4132-8465-d4011ca47775',volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:15:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-876d6daf-1ae8-4c2f-b8bf-34a0a8016fe3 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.721014 Apr 12 16:15:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 274/820] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:15:45 2023] POST /compute/v2.1/servers => generated 403 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:15:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b33411a3-9a39-41c4-a1e9-6bb19ef07964 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:45 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b33411a3-9a39-41c4-a1e9-6bb19ef07964 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:45 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b33411a3-9a39-41c4-a1e9-6bb19ef07964 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b33411a3-9a39-41c4-a1e9-6bb19ef07964 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1076 microversion: 2.1 time: 0.079159 Apr 12 16:15:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 271/821] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:45 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1076 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:15:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] Creating event network-changed:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:15:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-5672e5cb-afb7-40f4-a1a1-46138ddc2f9b req-298407c5-e61d-4cae-a111-af2a5ea4fe0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029799 Apr 12 16:15:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 277/822] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:15:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e50da005-c51d-4fa7-860a-0791184efdf0 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" status: 204 len: 0 microversion: 2.1 time: 0.134915 Apr 12 16:15:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 275/823] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:15:49 2023] DELETE /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:50 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:15:50 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f7a5dbcc-074c-42ac-b704-0641b7459336 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" status: 200 len: 1500 microversion: 2.1 time: 0.218955 Apr 12 16:15:50 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 272/824] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:15:50 2023] GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => generated 1500 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:15:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e", "name": "network-vif-unplugged", "status": "completed", "tag": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] Creating event network-vif-unplugged:adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e on user Apr 12 16:15:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-fb6f8052-613d-4d0b-b5a1-59cbd48992f6 req-a32c823c-2aa0-4f71-9205-f60b2e75db4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032536 Apr 12 16:15:50 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 278/825] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:15:51 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-4a98e9fd-3a86-401f-86fd-ace9a572a96c req-028c0004-8f9e-4cb4-9c41-1c7da408b688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e", "name": "network-vif-deleted", "tag": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4a98e9fd-3a86-401f-86fd-ace9a572a96c req-028c0004-8f9e-4cb4-9c41-1c7da408b688 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4a98e9fd-3a86-401f-86fd-ace9a572a96c req-028c0004-8f9e-4cb4-9c41-1c7da408b688 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4a98e9fd-3a86-401f-86fd-ace9a572a96c req-028c0004-8f9e-4cb4-9c41-1c7da408b688 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:51 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-4a98e9fd-3a86-401f-86fd-ace9a572a96c req-028c0004-8f9e-4cb4-9c41-1c7da408b688 service nova] Creating event network-vif-deleted:adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e on user Apr 12 16:15:51 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-4a98e9fd-3a86-401f-86fd-ace9a572a96c req-028c0004-8f9e-4cb4-9c41-1c7da408b688 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092082 Apr 12 16:15:51 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 276/826] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:52 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "947c2ca9-fd67-4e8d-b0dc-90c5c827a59e", "name": "network-vif-plugged", "status": "completed", "tag": "adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] Creating event network-vif-plugged:adb08d3a-a6bb-4c1d-8b23-fbe49e6ff7de for instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e on user Apr 12 16:15:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-7f45e988-0bae-4962-bfdc-16ffe27bf259 req-759992c6-6446-45db-be37-8a177c1def91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040599 Apr 12 16:15:52 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 273/827] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:54 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-plugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] Creating event network-vif-plugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:15:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-01d636f5-85ef-408c-a061-52a1e768cb35 req-01d6f495-7656-4187-86a5-36b2695609a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052692 Apr 12 16:15:54 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 279/828] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:15:56 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:56 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:15:56 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-plugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:15:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:15:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:15:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:15:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] Creating event network-vif-plugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:15:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-24659cc2-7ba9-4d2c-91d6-7aa0fcf34d0a req-05f92f0c-9b8f-4665-a449-7e9ff655a4d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035770 Apr 12 16:15:56 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 277/829] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:15:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=9 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=9 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:06 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2968ab22-115b-491f-9ecf-502964661aa8 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1536 microversion: 2.1 time: 0.158234 Apr 12 16:16:06 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 274/830] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:06 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1536 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Searching by: {'deleted': False, 'project_id': '236b9e609eb44071bc88971bff96931e'} {{(pid=61658) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=10 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=10 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:06 user devstack@n-api.service[61658]: DEBUG nova.compute.multi_cell_list [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61658) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 12 16:16:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e7a7629a-6356-4d19-8242-14c6b1726265 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.205425 Apr 12 16:16:06 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 280/831] 10.0.0.210 () {62 vars in 1202 bytes} [Wed Apr 12 16:16:06 2023] GET /compute/v2.1/servers => generated 341 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:06 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-b0684c4c-1d2b-437a-9dfd-c8aff0594988 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1536 microversion: 2.1 time: 0.157252 Apr 12 16:16:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 278/832] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:06 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1536 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63821959-5dfd-4f66-a6e5-90a20b30efab"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-70f5d78a-ec1c-4665-893f-22e9dea0dd10 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.553811 Apr 12 16:16:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 275/833] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:16:08 2023] POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments => generated 194 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: 473a30c4-5aa4-481c-8859-fda815d14872] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] HTTP exception thrown: Instance 473a30c4-5aa4-481c-8859-fda815d14872 could not be found. Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Request method failure captured: Apr 12 16:16:12 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 HTTP/1.1 Apr 12 16:16:12 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:16:12 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:16:12 user devstack@n-api.service[61658]: Connection: close Apr 12 16:16:12 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:16:12 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:16:12 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:16:12 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:16:12 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVUIREaEpSCxaDHhRTy1-3vG98zUQQrkdSdA21f2O72s3N3rIDmLgBOdKtY1raaQOA2q8xobAID4T92RRWByg3TQMewePmiVUfKjOk4N3mk2Chaqhzu21Gl8iq5G39Tfr8LyTLfxMsGVguI0Q0Es6MN889SFcfwJK58-JrBG9wNTTI Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Project-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Tenant-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:16:12 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:16:12 user devstack@n-api.service[61658]: X-User: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:16:12 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:16:12 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:16:12 user devstack@n-api.service[61658]: X-User-Id: 880266e3fa4d4dd889648c10208a1f8e Apr 12 16:16:12 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:16:12 user devstack@n-api.service[61658]: method: > Apr 12 16:16:12 user devstack@n-api.service[61658]: exception: Instance 473a30c4-5aa4-481c-8859-fda815d14872 could not be found. Apr 12 16:16:12 user devstack@n-api.service[61658]: action_args: {'id': '473a30c4-5aa4-481c-8859-fda815d14872'} Apr 12 16:16:12 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 473a30c4-5aa4-481c-8859-fda815d14872 could not be found. Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 473a30c4-5aa4-481c-8859-fda815d14872 could not be found. Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 473a30c4-5aa4-481c-8859-fda815d14872 could not be found. Apr 12 16:16:12 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Returning 404 to user: Instance 473a30c4-5aa4-481c-8859-fda815d14872 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:16:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b72960b8-6443-4b4a-8e25-b4c48225684c tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872" status: 404 len: 111 microversion: 2.1 time: 0.144402 Apr 12 16:16:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 281/834] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:12 2023] GET /compute/v2.1/servers/473a30c4-5aa4-481c-8859-fda815d14872 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:16:12 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'services' on Instance uuid 4190e244-84b1-47b6-813d-9cadb7c65975 {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:16:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-0c6e6dc4-cc92-43f0-bcfe-319575f5d37e tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 204 len: 0 microversion: 2.1 time: 0.127543 Apr 12 16:16:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 276/835] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:16:12 2023] DELETE /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ab3d7d0c-2770-4143-b6ee-b8bafb28b577 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-volume_attachments/ce38c1b3-35b0-48cc-9b83-e9a676997784" status: 202 len: 0 microversion: 2.1 time: 0.295292 Apr 12 16:16:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 279/836] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:16:12 2023] DELETE /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-volume_attachments/ce38c1b3-35b0-48cc-9b83-e9a676997784 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-unplugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] Creating event network-vif-unplugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:16:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-7e437b6e-5515-498e-8162-e88e73a98ade req-c31be11c-7c8d-4b8a-bfab-b29ac38e768c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096278 Apr 12 16:16:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 277/837] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:13 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '880266e3fa4d4dd889648c10208a1f8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe48a3b7d846a195f1e47cc7f69695', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-bbf71942-2db7-45c4-a4a2-99677a5fa9e6 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 200 len: 1510 microversion: 2.1 time: 0.476896 Apr 12 16:16:13 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 282/838] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:12 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 1510 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:16:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-deleted", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] Creating event network-vif-deleted:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:16:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-17632465-77ba-4511-b761-bf2c0a288c7f req-3ef791cb-1b4f-4092-9747-501edb61cf93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034372 Apr 12 16:16:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 280/839] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:14 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:14 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Going to try to stop instance {{(pid=61659) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 12 16:16:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-363ea77e-658d-4eae-a702-cb55b4eeefe1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action" status: 202 len: 0 microversion: 2.1 time: 0.076611 Apr 12 16:16:14 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 278/840] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:16:14 2023] POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afebffae-dbf6-4876-8c9f-0364f0fde49c", "name": "network-vif-plugged", "status": "completed", "tag": "c4b29e0b-0ad8-4897-acf3-76004ac0338b"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:15 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:15 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:15 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:15 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] Creating event network-vif-plugged:c4b29e0b-0ad8-4897-acf3-76004ac0338b for instance afebffae-dbf6-4876-8c9f-0364f0fde49c on user Apr 12 16:16:15 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-2fe33c4b-a526-4217-9ff5-4b2d2facb9a0 req-ad7fe980-ba58-45ac-be87-137b638281b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043821 Apr 12 16:16:15 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 281/841] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:15 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:15 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-809e1ecf-dd67-49d6-bde4-7a67fa90de01 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1666 microversion: 2.1 time: 0.176519 Apr 12 16:16:15 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 283/842] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:14 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1666 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:15 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7869b18e-4677-4688-972a-5517051be25c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 200 len: 1378 microversion: 2.1 time: 0.170744 Apr 12 16:16:15 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 279/843] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:15 2023] GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 1378 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:16 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-08b6aadf-34ae-4e6f-b85f-efc07ae38ffc tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1582 microversion: 2.1 time: 0.174014 Apr 12 16:16:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 282/844] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:16 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1582 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-unplugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}, {"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:17 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Creating event network-vif-unplugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:16:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:16:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-f50da646-1268-43aa-9913-5320524beadc req-36efc101-df6b-4428-82af-1dc35c568a18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032941 Apr 12 16:16:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 284/845] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:17 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] Creating event network-changed:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:16:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-33681586-90be-4b6f-84ac-d73692d9fa40 req-5f3af5f9-bed1-4a2c-8cb2-fb13570a95c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033928 Apr 12 16:16:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 280/846] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1984278615"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:19 user devstack@n-api.service[61657]: INFO nova.network.security_group_api [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Adding security group 5e111031-494e-4a80-b034-2549e3608be3 to port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 Apr 12 16:16:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a1d3d9fa-12d1-4cbd-8519-e7b3dba3acb5 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/action" status: 202 len: 0 microversion: 2.1 time: 0.919210 Apr 12 16:16:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 283/847] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:16:19 2023] POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/action => generated 0 bytes in 921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] Creating event network-changed:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:16:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-c89288e1-ec58-40dd-a238-9ec2255f189a req-344efc60-8ed4-48ca-921d-ac7572d10425 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036306 Apr 12 16:16:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 281/848] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:20 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b5c0c5f9-a83b-4211-a472-e9e343a6b325 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1748 microversion: 2.1 time: 0.157278 Apr 12 16:16:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 285/849] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:20 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d0d23f0b-9665-49f1-8bba-3f1cd8219575 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/action" status: 202 len: 0 microversion: 2.1 time: 0.083641 Apr 12 16:16:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 284/850] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:16:20 2023] POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:21 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:21 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d274907f-c753-44a2-b783-15d2c828c7a6 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1740 microversion: 2.1 time: 0.234252 Apr 12 16:16:21 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 282/851] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:20 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-unplugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] Creating event network-vif-unplugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:16:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-2468b7a8-2700-4c78-9454-78207bc73ebd req-af01d0d2-5c4a-48c7-b16a-ae68b3313ab3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032109 Apr 12 16:16:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 286/852] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-plugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] Creating event network-vif-plugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:16:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-e096da37-55ad-41fa-bedb-3db1363399ab req-8e6b9d8d-7e91-4eb8-a70a-dc122847fa48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053425 Apr 12 16:16:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 285/853] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:27 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:16:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f0ca9461-f152-4583-a736-665781685ba3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 204 len: 0 microversion: 2.87 time: 0.257178 Apr 12 16:16:27 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 283/854] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:16:27 2023] DELETE /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:27 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-a18a0e17-448c-4f5e-9800-104c7ebf604a tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 200 len: 1775 microversion: 2.87 time: 0.218674 Apr 12 16:16:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 287/855] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:16:27 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 1775 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:16:28 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-plugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}, {"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-plugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:28 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Creating event network-vif-plugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:16:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] Creating event network-vif-plugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:16:28 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-6e8872c6-d625-426b-90be-cfd87e69d870 req-3d97afe9-0c3c-4564-8098-007382089db8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045619 Apr 12 16:16:28 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 286/856] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-unplugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:29 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] Creating event network-vif-unplugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:16:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-4459af7e-357e-4fbf-a66c-8aa7de8fc797 req-362ba96e-45f1-4649-9091-3f2f02d07098 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032992 Apr 12 16:16:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 284/857] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:29 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:31 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-53b0cac6-162c-4f10-a362-8b20700e462c req-d12de7c9-980a-429a-b7f3-270735bb267d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-deleted", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-53b0cac6-162c-4f10-a362-8b20700e462c req-d12de7c9-980a-429a-b7f3-270735bb267d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-53b0cac6-162c-4f10-a362-8b20700e462c req-d12de7c9-980a-429a-b7f3-270735bb267d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:31 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-53b0cac6-162c-4f10-a362-8b20700e462c req-d12de7c9-980a-429a-b7f3-270735bb267d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:31 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-53b0cac6-162c-4f10-a362-8b20700e462c req-d12de7c9-980a-429a-b7f3-270735bb267d service nova] Creating event network-vif-deleted:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:16:31 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-53b0cac6-162c-4f10-a362-8b20700e462c req-d12de7c9-980a-429a-b7f3-270735bb267d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053154 Apr 12 16:16:31 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 288/858] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:31 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e8a977c-aa84-47c4-a838-b5f90820de1a", "name": "network-vif-plugged", "status": "completed", "tag": "40e16d3f-2e2e-45df-be16-ef3622bfde2e"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:31 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] Creating event network-vif-plugged:40e16d3f-2e2e-45df-be16-ef3622bfde2e for instance 0e8a977c-aa84-47c4-a838-b5f90820de1a on user Apr 12 16:16:31 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a87c55ff-cca7-4740-82e7-4a4e92eec802 req-b0dce4e7-a1a7-4a4a-a255-744b006896a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030116 Apr 12 16:16:31 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 287/859] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:32 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3823da50be004112aaa5ee35b724c6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d8082517724895a2027594f440071d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:32 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-29d2550f-6404-4eb2-8486-682714f68523 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5" status: 200 len: 1566 microversion: 2.1 time: 0.155897 Apr 12 16:16:32 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 285/860] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:32 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] Creating event network-changed:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:16:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-74beebf4-07e2-486f-b4fb-d0a5d1685d81 req-51179c82-3e0c-429e-9245-0ad3b22876dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032957 Apr 12 16:16:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 289/861] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:16:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ce30534-445d-4386-acd3-b41a1946b625"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:36 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:36 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7c69ac2c-b690-4886-9135-30376df03783 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1428 microversion: 2.1 time: 0.169475 Apr 12 16:16:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 288/862] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:35 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1428 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-3011c593-f3a8-45ed-8e34-6e8fabdbb41d tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.377131 Apr 12 16:16:36 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 286/863] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:16:35 2023] POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=23 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=43 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] HTTP exception thrown: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Request method failure captured: Apr 12 16:16:40 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e HTTP/1.1 Apr 12 16:16:40 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:16:40 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:16:40 user devstack@n-api.service[61658]: Connection: close Apr 12 16:16:40 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:16:40 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:16:40 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:16:40 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:16:40 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNthXKmRzGDp6W7hfu3MsqU660viKFJPVHYOmmVh5q4O21qCwXBst4UFVtIETOWZXw0cOYzX7lGyhKCYl45iEXdmdHXx7g3ZUuVMLJSC4B1gpA-yGjT2NM8Z6HYXsIpYCt2xoBsAth2xe2V6xcA9_fTAABjy7k-K8qpDQ2CYfLMIdNBU Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Project-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Tenant: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Tenant-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:16:40 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:16:40 user devstack@n-api.service[61658]: X-User: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:16:40 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:16:40 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:16:40 user devstack@n-api.service[61658]: X-User-Id: 38c60e84c47047e2886220f2ef54391d Apr 12 16:16:40 user devstack@n-api.service[61658]: X-User-Name: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:16:40 user devstack@n-api.service[61658]: method: > Apr 12 16:16:40 user devstack@n-api.service[61658]: exception: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:16:40 user devstack@n-api.service[61658]: action_args: {'id': '947c2ca9-fd67-4e8d-b0dc-90c5c827a59e'} Apr 12 16:16:40 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:16:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:16:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Returning 404 to user: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:16:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-9c50d757-920b-46ea-a257-85bf16a6e66c tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" status: 404 len: 111 microversion: 2.1 time: 0.040163 Apr 12 16:16:40 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 290/864] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:40 2023] GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:40 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:16:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a13a6e8f-d44f-44a0-b1e8-f5e954dbf455 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 200 len: 1493 microversion: 2.1 time: 0.166179 Apr 12 16:16:40 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 289/865] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:16:40 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 1493 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=5,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:52 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'services' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:16:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b14147da-6e94-4022-89d7-9a1bb662d1ba tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/4ce30534-445d-4386-acd3-b41a1946b625" status: 202 len: 0 microversion: 2.1 time: 0.163511 Apr 12 16:16:52 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 287/866] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:16:52 2023] DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/4ce30534-445d-4386-acd3-b41a1946b625 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:16:52 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:16:52 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-76bd0fc6-a4ed-4528-bd99-a1bd005922dc tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Apr 12 16:16:52 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 291/867] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:16:52 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=21 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] [instance: afebffae-dbf6-4876-8c9f-0364f0fde49c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] HTTP exception thrown: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c could not be found. Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Request method failure captured: Apr 12 16:17:03 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c HTTP/1.1 Apr 12 16:17:03 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:17:03 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:17:03 user devstack@n-api.service[61657]: Connection: close Apr 12 16:17:03 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:17:03 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:17:03 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:17:03 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:17:03 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVUIREaEpSCxaDHhRTy1-3vG98zUQQrkdSdA21f2O72s3N3rIDmLgBOdKtY1raaQOA2q8xobAID4T92RRWByg3TQMewePmiVUfKjOk4N3mk2Chaqhzu21Gl8iq5G39Tfr8LyTLfxMsGVguI0Q0Es6MN889SFcfwJK58-JrBG9wNTTI Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Project-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3fe48a3b7d846a195f1e47cc7f69695"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Tenant: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Tenant-Id: b3fe48a3b7d846a195f1e47cc7f69695 Apr 12 16:17:03 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-984710343 Apr 12 16:17:03 user devstack@n-api.service[61657]: X-User: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:17:03 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:17:03 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:17:03 user devstack@n-api.service[61657]: X-User-Id: 880266e3fa4d4dd889648c10208a1f8e Apr 12 16:17:03 user devstack@n-api.service[61657]: X-User-Name: tempest-ServerRescueNegativeTestJSON-984710343-project-member Apr 12 16:17:03 user devstack@n-api.service[61657]: method: > Apr 12 16:17:03 user devstack@n-api.service[61657]: exception: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c could not be found. Apr 12 16:17:03 user devstack@n-api.service[61657]: action_args: {'id': 'afebffae-dbf6-4876-8c9f-0364f0fde49c'} Apr 12 16:17:03 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c could not be found. Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c could not be found. Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c could not be found. Apr 12 16:17:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:17:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] Returning 404 to user: Instance afebffae-dbf6-4876-8c9f-0364f0fde49c could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:17:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-67e1afc9-22f8-4d10-8821-a695f4fab006 tempest-ServerRescueNegativeTestJSON-984710343 tempest-ServerRescueNegativeTestJSON-984710343-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c" status: 404 len: 111 microversion: 2.1 time: 0.038720 Apr 12 16:17:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 290/868] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:03 2023] GET /compute/v2.1/servers/afebffae-dbf6-4876-8c9f-0364f0fde49c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:05 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-e13a32ec-fe48-4907-8bb8-caadf5946beb tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1643 microversion: 2.1 time: 0.228093 Apr 12 16:17:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 288/869] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:05 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1643 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:11 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5325c147-849d-4a91-bd86-ade6056d9d0b tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1748 microversion: 2.1 time: 0.172479 Apr 12 16:17:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 292/870] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:11 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1748 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-df96294c-bb2c-4d0c-8e15-71290827bdea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 200 len: 1378 microversion: 2.1 time: 0.170628 Apr 12 16:17:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 291/871] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:16 2023] GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 1378 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-843d06fc-e8bb-4986-8474-8496d6b09f56 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 200 len: 1378 microversion: 2.1 time: 0.175830 Apr 12 16:17:16 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 289/872] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:16 2023] GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 1378 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:17:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-adb42830-66aa-4d05-a25d-46f4b40054fb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 204 len: 0 microversion: 2.1 time: 0.136362 Apr 12 16:17:16 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 293/873] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:17:16 2023] DELETE /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:16 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-dd8ade53-633c-4abe-9f17-59989822e527 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 200 len: 1384 microversion: 2.1 time: 0.171959 Apr 12 16:17:16 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 292/874] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:16 2023] GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 1384 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59", "name": "network-vif-unplugged", "status": "completed", "tag": "e3207e92-f3c0-4115-bda1-f02903827226"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] Creating event network-vif-unplugged:e3207e92-f3c0-4115-bda1-f02903827226 for instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 on user Apr 12 16:17:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-e8c7c8b9-a081-41f1-b358-c5a0d8df0dc1 req-cfae1975-3805-4fa4-89b7-9c56b585f053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033484 Apr 12 16:17:16 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 290/875] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 0e8a977c-aa84-47c4-a838-b5f90820de1a] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HTTP exception thrown: Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a could not be found. Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Request method failure captured: Apr 12 16:17:17 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a HTTP/1.1 Apr 12 16:17:17 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:17:17 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:17:17 user devstack@n-api.service[61658]: Connection: close Apr 12 16:17:17 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:17:17 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:17:17 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:17:17 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:17:17 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVYYBXv3KMlc-Z7sQF-RkZWC2YP3S9HWAy7Hok1TmTYJjbK2C90ck9c7nWqj2YiVgqcl7U6sTwx8t8ucFrBvgc33dcU9tw-vXDrUzvXnRKG64BjxA6fAjqqFs3NuEu1WA1mlzLTV0BLb4GGP9WZSMDyldJ5id3caWuZz9p308d737Q Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Project-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9210f81232304e179d3e09914a492442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Tenant-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:17:17 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:17:17 user devstack@n-api.service[61658]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:17:17 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:17:17 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:17:17 user devstack@n-api.service[61658]: X-User-Id: 73f9fa5bc22a4824b3cdcb8cf7bb380c Apr 12 16:17:17 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:17:17 user devstack@n-api.service[61658]: method: > Apr 12 16:17:17 user devstack@n-api.service[61658]: exception: Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a could not be found. Apr 12 16:17:17 user devstack@n-api.service[61658]: action_args: {'id': '0e8a977c-aa84-47c4-a838-b5f90820de1a'} Apr 12 16:17:17 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a could not be found. Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a could not be found. Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a could not be found. Apr 12 16:17:17 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:17:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Returning 404 to user: Instance 0e8a977c-aa84-47c4-a838-b5f90820de1a could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:17:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-8fa96919-73ea-4381-b2c0-6c036a2ba0d8 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a" status: 404 len: 111 microversion: 2.87 time: 0.031123 Apr 12 16:17:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 294/876] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:17:17 2023] GET /compute/v2.1/servers/0e8a977c-aa84-47c4-a838-b5f90820de1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:17:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3f2b7079-c8c1-49c2-a234-74c234f90844 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c" status: 204 len: 0 microversion: 2.87 time: 0.118105 Apr 12 16:17:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 293/877] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:17:18 2023] DELETE /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:18 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-04fbc9a8-4e0d-41db-9ed5-9ca4957018dc tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c" status: 200 len: 1697 microversion: 2.87 time: 0.241486 Apr 12 16:17:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 291/878] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:17:18 2023] GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c => generated 1697 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:17:18 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ae41d-b098-4126-ace7-3da00b40cb9c", "name": "network-vif-unplugged", "status": "completed", "tag": "6aeec58e-a9ce-429d-a931-f860d7352c2e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:18 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] Creating event network-vif-unplugged:6aeec58e-a9ce-429d-a931-f860d7352c2e for instance 016ae41d-b098-4126-ace7-3da00b40cb9c on user Apr 12 16:17:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-5f566533-4e64-4933-8238-7b10bcbd7ac2 req-05def5fc-b5f6-489a-bc42-8e1a1717362c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035010 Apr 12 16:17:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 295/879] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59", "name": "network-vif-plugged", "status": "completed", "tag": "e3207e92-f3c0-4115-bda1-f02903827226"}, {"server_uuid": "f42c5cf7-5b0c-4519-a8dc-4022eb20fa59", "name": "network-vif-deleted", "tag": "e3207e92-f3c0-4115-bda1-f02903827226"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Creating event network-vif-plugged:e3207e92-f3c0-4115-bda1-f02903827226 for instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 on user Apr 12 16:17:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] Creating event network-vif-deleted:e3207e92-f3c0-4115-bda1-f02903827226 for instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 on user Apr 12 16:17:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-36bd5610-cbb0-4ab4-9fa1-ac5879489ca5 req-5e390d72-f869-4f9f-afd0-ca917925b9b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032729 Apr 12 16:17:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 294/880] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ae41d-b098-4126-ace7-3da00b40cb9c", "name": "network-vif-plugged", "status": "completed", "tag": "6aeec58e-a9ce-429d-a931-f860d7352c2e"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] Creating event network-vif-plugged:6aeec58e-a9ce-429d-a931-f860d7352c2e for instance 016ae41d-b098-4126-ace7-3da00b40cb9c on user Apr 12 16:17:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-89ed1e9b-8bcc-449d-921d-1a4818005c68 req-329405d3-2156-4941-8c99-1c5e7195ed0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031098 Apr 12 16:17:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 292/881] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-bd51522b-82b8-4474-b170-5a86a57d61af req-bf58e2d4-a648-4a5d-8181-6a57a5ac71c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016ae41d-b098-4126-ace7-3da00b40cb9c", "name": "network-vif-deleted", "tag": "6aeec58e-a9ce-429d-a931-f860d7352c2e"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bd51522b-82b8-4474-b170-5a86a57d61af req-bf58e2d4-a648-4a5d-8181-6a57a5ac71c7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bd51522b-82b8-4474-b170-5a86a57d61af req-bf58e2d4-a648-4a5d-8181-6a57a5ac71c7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-bd51522b-82b8-4474-b170-5a86a57d61af req-bf58e2d4-a648-4a5d-8181-6a57a5ac71c7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-bd51522b-82b8-4474-b170-5a86a57d61af req-bf58e2d4-a648-4a5d-8181-6a57a5ac71c7 service nova] Creating event network-vif-deleted:6aeec58e-a9ce-429d-a931-f860d7352c2e for instance 016ae41d-b098-4126-ace7-3da00b40cb9c on user Apr 12 16:17:21 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-bd51522b-82b8-4474-b170-5a86a57d61af req-bf58e2d4-a648-4a5d-8181-6a57a5ac71c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036958 Apr 12 16:17:21 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 296/882] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:36 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-98781245-ba41-47cd-9d4c-bace89a697af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.092465 Apr 12 16:17:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 295/883] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:17:36 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/os-interface => generated 283 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=10 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=16 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] Creating event network-changed:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-4d6c1a88-b467-454d-8185-f923b4e6aaa2 req-434acfc9-c803-4b2f-9beb-4e611c49a9c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037854 Apr 12 16:17:37 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 293/884] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:37 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-711abeb2-6767-4863-a673-62dc424add3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1428 microversion: 2.1 time: 0.180079 Apr 12 16:17:37 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 297/885] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:37 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1428 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Old instance type m1.nano, new instance type m1.micro {{(pid=61657) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Getting quotas for user 1a699b3ba8304eadb8a53d465ea340cf and project 97ea81bd1962466bbe552424973f71a8. Resources: {'ram', 'cores'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:17:37 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:17:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-65ed96a6-64b1-46ba-919e-635ffa2ec14b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/action" status: 202 len: 0 microversion: 2.1 time: 0.158908 Apr 12 16:17:37 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 296/886] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:17:37 2023] POST /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:37 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b1a3f944-93d1-40da-a5d4-3991fe1b336b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1437 microversion: 2.1 time: 0.156903 Apr 12 16:17:37 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 294/887] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:37 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1437 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Creating event network-changed:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:17:39 user devstack@n-api.service[61658]: DEBUG nova.compute.api [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] Instance bef10c89-360e-42d6-aa26-7edf1afca567 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61658) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:17:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-badef273-20a3-4fbd-8c4d-d834d7512e79 req-4cff0207-d493-45d7-9b53-62ac1b9f49f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037974 Apr 12 16:17:39 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 298/888] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:40 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-unplugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Creating event network-vif-unplugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:17:40 user devstack@n-api.service[61657]: DEBUG nova.compute.api [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] Instance bef10c89-360e-42d6-aa26-7edf1afca567 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61657) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:17:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3a99739d-b8c9-40bd-af00-bbc6ce67c171 req-d11c2da1-a493-4d44-90ce-0f9b40cb848c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059087 Apr 12 16:17:40 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 297/889] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:40 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8d4001bf-0a44-43ed-b1b0-6fe3db287de3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-882273984", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b7c4a359-4d4b-4d9c-92be-f680964bd1d7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "89a33fcd-81e9-4815-8644-d9b33ceb236b"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-95cd4fd7-7aaa-4955-9ee7-56795044ead7 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065892 Apr 12 16:17:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 299/890] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:17:42 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:17:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-8d4001bf-0a44-43ed-b1b0-6fe3db287de3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] HTTP exception thrown: Block Device b7c4a359-4d4b-4d9c-92be-f680964bd1d7 is not bootable. Apr 12 16:17:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8d4001bf-0a44-43ed-b1b0-6fe3db287de3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Request method failure captured: Apr 12 16:17:42 user devstack@n-api.service[61659]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 16:17:42 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:17:42 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:17:42 user devstack@n-api.service[61659]: Connection: close Apr 12 16:17:42 user devstack@n-api.service[61659]: Content-Length: 356 Apr 12 16:17:42 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:17:42 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:17:42 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:17:42 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNthXKmRzGDp6W7hfu3MsqU660viKFJPVHYOmmVh5q4O21qCwXBst4UFVtIETOWZXw0cOYzX7lGyhKCYl45iEXdmdHXx7g3ZUuVMLJSC4B1gpA-yGjT2NM8Z6HYXsIpYCt2xoBsAth2xe2V6xcA9_fTAABjy7k-K8qpDQ2CYfLMIdNBU Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Project-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Project-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Tenant: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Tenant-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:17:42 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:17:42 user devstack@n-api.service[61659]: X-User: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:17:42 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:17:42 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:17:42 user devstack@n-api.service[61659]: X-User-Id: 38c60e84c47047e2886220f2ef54391d Apr 12 16:17:42 user devstack@n-api.service[61659]: X-User-Name: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:17:42 user devstack@n-api.service[61659]: Apr 12 16:17:42 user devstack@n-api.service[61659]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-882273984", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "b7c4a359-4d4b-4d9c-92be-f680964bd1d7", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "89a33fcd-81e9-4815-8644-d9b33ceb236b"}]}} Apr 12 16:17:42 user devstack@n-api.service[61659]: method: > Apr 12 16:17:42 user devstack@n-api.service[61659]: exception: Block Device b7c4a359-4d4b-4d9c-92be-f680964bd1d7 is not bootable. Apr 12 16:17:42 user devstack@n-api.service[61659]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-882273984', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'b7c4a359-4d4b-4d9c-92be-f680964bd1d7'}], 'networks': [{'uuid': '89a33fcd-81e9-4815-8644-d9b33ceb236b'}]}}} Apr 12 16:17:42 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device b7c4a359-4d4b-4d9c-92be-f680964bd1d7 is not bootable. Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device b7c4a359-4d4b-4d9c-92be-f680964bd1d7 is not bootable. Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device b7c4a359-4d4b-4d9c-92be-f680964bd1d7 is not bootable. Apr 12 16:17:42 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:17:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8d4001bf-0a44-43ed-b1b0-6fe3db287de3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Returning 400 to user: Block Device b7c4a359-4d4b-4d9c-92be-f680964bd1d7 is not bootable. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:17:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8d4001bf-0a44-43ed-b1b0-6fe3db287de3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.081079 Apr 12 16:17:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 295/891] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:17:42 2023] POST /compute/v2.1/servers => generated 110 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-plugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Creating event network-vif-plugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:17:42 user devstack@n-api.service[61658]: DEBUG nova.compute.api [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] Instance bef10c89-360e-42d6-aa26-7edf1afca567 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61658) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:17:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-ff6f568a-23bb-40bb-b462-c5af616ceb61 req-9a90cf47-6661-4b9e-a9d3-13510d931a51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039875 Apr 12 16:17:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 300/892] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:42 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:17:42 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-5b20f9e3-3c25-42f1-8f33-b454619b03f2 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 200 len: 1493 microversion: 2.1 time: 0.167142 Apr 12 16:17:42 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 298/893] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:17:42 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 1493 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f226cff8-461e-4933-9803-280654a66125"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-32074722-9dad-4b8e-b284-22fa3bca9012 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307143 Apr 12 16:17:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 296/894] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:17:45 2023] POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-plugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Creating event network-vif-plugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:17:51 user devstack@n-api.service[61658]: DEBUG nova.compute.api [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] Instance bef10c89-360e-42d6-aa26-7edf1afca567 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61658) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:17:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d268c992-b032-47d3-bde3-4423ccf7d119 req-75df045f-041b-4d1f-a37e-b81a6ed78c92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042650 Apr 12 16:17:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 301/895] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-plugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=20 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Creating event network-vif-plugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:17:53 user devstack@n-api.service[61657]: DEBUG nova.compute.api [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] Instance bef10c89-360e-42d6-aa26-7edf1afca567 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61657) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 12 16:17:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-b8635af7-141f-44a8-8c14-56f74177ebf1 req-07e452aa-cd7a-4be6-aff5-9f7b82959047 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043910 Apr 12 16:17:53 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 299/896] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:17:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:54 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'services' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:17:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-64a039c4-fb74-4ae4-b093-d3e37b23419b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/f226cff8-461e-4933-9803-280654a66125" status: 202 len: 0 microversion: 2.1 time: 0.218327 Apr 12 16:17:54 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 297/897] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:17:53 2023] DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/f226cff8-461e-4933-9803-280654a66125 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:17:54 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:17:54 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e7920350-88ff-48b7-aa9a-7c4b7d4bda15 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055541 Apr 12 16:17:54 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 302/898] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:17:54 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:05 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:05 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:05 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Going to try to start instance {{(pid=61657) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 12 16:18:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-0aaccf0e-ec39-4a02-a484-c1218277a94e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action" status: 202 len: 0 microversion: 2.1 time: 0.083695 Apr 12 16:18:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 300/899] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:18:05 2023] POST /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=10 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:05 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-406dbe5c-5cfd-4c93-ad51-dc08d8d9c437 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1652 microversion: 2.1 time: 0.171994 Apr 12 16:18:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 298/900] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:18:05 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1652 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=12 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=30 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:18:06 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 HTTP/1.1 Apr 12 16:18:06 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:18:06 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:18:06 user devstack@n-api.service[61658]: Connection: close Apr 12 16:18:06 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:18:06 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:18:06 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:18:06 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:18:06 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:18:06 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61658]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:18:06 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:18:06 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:18:06 user devstack@n-api.service[61658]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:18:06 user devstack@n-api.service[61658]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:18:06 user devstack@n-api.service[61658]: method: > Apr 12 16:18:06 user devstack@n-api.service[61658]: exception: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61658]: action_args: {'id': 'f42c5cf7-5b0c-4519-a8dc-4022eb20fa59'} Apr 12 16:18:06 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:18:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-71b77dcd-e6a6-4109-afa0-6a9fae044e5d tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 404 len: 111 microversion: 2.1 time: 0.036076 Apr 12 16:18:06 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 303/901] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:18:06 2023] GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:18:06 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 HTTP/1.1 Apr 12 16:18:06 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:18:06 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:18:06 user devstack@n-api.service[61657]: Connection: close Apr 12 16:18:06 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:18:06 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:18:06 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:18:06 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:18:06 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:18:06 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61657]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:18:06 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:18:06 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:18:06 user devstack@n-api.service[61657]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:18:06 user devstack@n-api.service[61657]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:18:06 user devstack@n-api.service[61657]: method: > Apr 12 16:18:06 user devstack@n-api.service[61657]: exception: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61657]: action_args: {'id': 'f42c5cf7-5b0c-4519-a8dc-4022eb20fa59'} Apr 12 16:18:06 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:18:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ccce4d75-4fc7-4ce2-8493-90734cd699a7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 404 len: 111 microversion: 2.1 time: 0.030580 Apr 12 16:18:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 301/902] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:18:06 2023] DELETE /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: f42c5cf7-5b0c-4519-a8dc-4022eb20fa59] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:18:06 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 HTTP/1.1 Apr 12 16:18:06 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:18:06 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:18:06 user devstack@n-api.service[61659]: Connection: close Apr 12 16:18:06 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:18:06 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:18:06 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:18:06 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:18:06 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:18:06 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:18:06 user devstack@n-api.service[61659]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:18:06 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:18:06 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:18:06 user devstack@n-api.service[61659]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:18:06 user devstack@n-api.service[61659]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:18:06 user devstack@n-api.service[61659]: method: > Apr 12 16:18:06 user devstack@n-api.service[61659]: exception: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61659]: action_args: {'id': 'f42c5cf7-5b0c-4519-a8dc-4022eb20fa59'} Apr 12 16:18:06 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. Apr 12 16:18:06 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:06 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:18:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6a37311b-8ace-4af9-9743-bdf9e835fdef tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59" status: 404 len: 111 microversion: 2.1 time: 0.030888 Apr 12 16:18:06 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 299/903] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:18:06 2023] GET /compute/v2.1/servers/f42c5cf7-5b0c-4519-a8dc-4022eb20fa59 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 016ae41d-b098-4126-ace7-3da00b40cb9c] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HTTP exception thrown: Instance 016ae41d-b098-4126-ace7-3da00b40cb9c could not be found. Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Request method failure captured: Apr 12 16:18:08 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c HTTP/1.1 Apr 12 16:18:08 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:18:08 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:18:08 user devstack@n-api.service[61658]: Connection: close Apr 12 16:18:08 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:18:08 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:18:08 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:18:08 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:18:08 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVYYBXv3KMlc-Z7sQF-RkZWC2YP3S9HWAy7Hok1TmTYJjbK2C90ck9c7nWqj2YiVgqcl7U6sTwx8t8ucFrBvgc33dcU9tw-vXDrUzvXnRKG64BjxA6fAjqqFs3NuEu1WA1mlzLTV0BLb4GGP9WZSMDyldJ5id3caWuZz9p308d737Q Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Project-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9210f81232304e179d3e09914a492442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Tenant-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:18:08 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:18:08 user devstack@n-api.service[61658]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:18:08 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:18:08 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:18:08 user devstack@n-api.service[61658]: X-User-Id: 73f9fa5bc22a4824b3cdcb8cf7bb380c Apr 12 16:18:08 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:18:08 user devstack@n-api.service[61658]: method: > Apr 12 16:18:08 user devstack@n-api.service[61658]: exception: Instance 016ae41d-b098-4126-ace7-3da00b40cb9c could not be found. Apr 12 16:18:08 user devstack@n-api.service[61658]: action_args: {'id': '016ae41d-b098-4126-ace7-3da00b40cb9c'} Apr 12 16:18:08 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 016ae41d-b098-4126-ace7-3da00b40cb9c could not be found. Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 016ae41d-b098-4126-ace7-3da00b40cb9c could not be found. Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 016ae41d-b098-4126-ace7-3da00b40cb9c could not be found. Apr 12 16:18:08 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Returning 404 to user: Instance 016ae41d-b098-4126-ace7-3da00b40cb9c could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:18:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6b19ded4-b792-4630-8a66-6246702689f7 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c" status: 404 len: 111 microversion: 2.87 time: 0.039764 Apr 12 16:18:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 304/904] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:18:08 2023] GET /compute/v2.1/servers/016ae41d-b098-4126-ace7-3da00b40cb9c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:18:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-608cce95-fcf5-45a1-88e8-d8634ed9cd31 req-22570b52-031f-4e16-a109-20041ee51d30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079067 Apr 12 16:18:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 302/905] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:18:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-75c15527-7517-4c4e-ba4f-8c623e014837 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 204 len: 0 microversion: 2.87 time: 0.250592 Apr 12 16:18:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 300/906] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:18:08 2023] DELETE /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:09 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:09 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:09 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-701eb425-cc54-416d-87b6-6f08e4e83f60 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 200 len: 1775 microversion: 2.87 time: 0.259928 Apr 12 16:18:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 305/907] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:18:08 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 1775 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:18:09 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-unplugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] Creating event network-vif-unplugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:18:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-073e018f-752b-4dc7-a7bc-5ee62849377d req-11844588-f080-4113-abfc-7ffa26d5cb8e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043732 Apr 12 16:18:09 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 303/908] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-deleted", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] Creating event network-vif-deleted:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:18:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-14d56617-4e0d-45e3-8f56-d7c63b733472 req-6b0d6dc5-ac8b-4b72-9f73-399a7b5e824f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038266 Apr 12 16:18:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 301/909] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:18:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d4b3b37e-7e28-4e9a-ae8e-be60d972d969 req-163a2ff0-8cac-4721-a9f0-518d8f99d656 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033003 Apr 12 16:18:10 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 306/910] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:11 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f52ee906-c8fd-4cd5-842e-de98a5099c4f", "name": "network-vif-plugged", "status": "completed", "tag": "955511f0-eca8-447d-a105-fdd5f182de62"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] Creating event network-vif-plugged:955511f0-eca8-447d-a105-fdd5f182de62 for instance f52ee906-c8fd-4cd5-842e-de98a5099c4f on user Apr 12 16:18:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a7e45348-2eb0-4988-82d2-e2130fc978af req-3cfd0a6f-d62e-4608-8258-aa731079f6dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044806 Apr 12 16:18:11 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 304/911] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1984278615"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:11 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:11 user devstack@n-api.service[61659]: INFO nova.network.security_group_api [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Removing security group 5e111031-494e-4a80-b034-2549e3608be3 from port d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 Apr 12 16:18:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-66a66c64-4c50-4e71-9703-ece2c5752521 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/action" status: 202 len: 0 microversion: 2.1 time: 0.668391 Apr 12 16:18:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 302/912] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:18:11 2023] POST /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:18:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] Creating event network-changed:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:18:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-c67dede3-7d27-4f4d-9a21-6adf94c0346f req-057f6d4a-c39a-4c70-8491-48037dc9a4b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032392 Apr 12 16:18:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 307/913] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] Creating event network-changed:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:18:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-9db50534-2fa0-48a3-91d5-1b27ede0bff0 req-74e6847b-971b-4d37-bc6b-639e1aad754e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038361 Apr 12 16:18:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 303/914] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:13 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lazy-loading 'services' on Instance uuid b4c37cbf-1743-4dd5-97fd-2bb12ebee763 {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:18:13 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-a11fa36b-0930-4d12-8597-015eda7500f3 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments/63821959-5dfd-4f66-a6e5-90a20b30efab" status: 202 len: 0 microversion: 2.1 time: 0.173156 Apr 12 16:18:13 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 305/915] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:18:13 2023] DELETE /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments/63821959-5dfd-4f66-a6e5-90a20b30efab => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:13 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:13 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-96307a6c-8e3c-49c0-9330-8cebf61271b1 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048302 Apr 12 16:18:13 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 308/916] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:18:13 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1534459262", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "952c0ad3-7b56-454e-af58-10213195373d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "1439244b-8287-4bba-a88c-99d4b498cccd"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] validate_networks() for [('1439244b-8287-4bba-a88c-99d4b498cccd', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for user 7054687447fc42339e9046ced4915890 and project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:18:14 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='952c0ad3-7b56-454e-af58-10213195373d',volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:18:15 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c699c40c-42ae-4799-9b2c-b32d03f991ea tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.767213 Apr 12 16:18:15 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 304/917] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:18:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:18:15 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-83fab4bc-f678-4525-8acc-f398ba179554 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:15 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-83fab4bc-f678-4525-8acc-f398ba179554 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:15 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-83fab4bc-f678-4525-8acc-f398ba179554 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:15 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-83fab4bc-f678-4525-8acc-f398ba179554 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 200 len: 1066 microversion: 2.1 time: 0.124721 Apr 12 16:18:15 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 306/918] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:18:15 2023] GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 1066 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:17 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77842113-37e8-4dc3-bd28-84417eb1ac31", "tag": "c9b27dd5-a751-4179-af86-77931b5f55e6"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:17 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] Creating event network-changed:c9b27dd5-a751-4179-af86-77931b5f55e6 for instance 77842113-37e8-4dc3-bd28-84417eb1ac31 on user Apr 12 16:18:17 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-fa00f27b-4e25-49c7-b3e5-db863ca46968 req-152051fd-3c61-4643-9029-77b666b3e518 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034126 Apr 12 16:18:17 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 309/919] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77842113-37e8-4dc3-bd28-84417eb1ac31", "name": "network-vif-plugged", "status": "completed", "tag": "c9b27dd5-a751-4179-af86-77931b5f55e6"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] Creating event network-vif-plugged:c9b27dd5-a751-4179-af86-77931b5f55e6 for instance 77842113-37e8-4dc3-bd28-84417eb1ac31 on user Apr 12 16:18:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-995eec94-b7d8-4835-9c16-6e5bd370ac24 req-be354bf9-da43-4969-9ae4-a3dc4e2845eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051431 Apr 12 16:18:24 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 305/920] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77842113-37e8-4dc3-bd28-84417eb1ac31", "name": "network-vif-plugged", "status": "completed", "tag": "c9b27dd5-a751-4179-af86-77931b5f55e6"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=16 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] Creating event network-vif-plugged:c9b27dd5-a751-4179-af86-77931b5f55e6 for instance 77842113-37e8-4dc3-bd28-84417eb1ac31 on user Apr 12 16:18:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a1910bb2-8adf-411d-af06-0a7aef08d36b req-089fa473-e058-43fc-8bcc-3e1b0259368c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052340 Apr 12 16:18:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 307/921] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=16 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=22 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:28 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-8da33c88-ad19-4312-b88d-1839ba5fb81b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1555 microversion: 2.1 time: 0.233274 Apr 12 16:18:28 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 310/922] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:18:27 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1555 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:42 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a675f83e-e20b-45bd-b2e4-1a7d41a8a7a3 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 200 len: 1493 microversion: 2.1 time: 0.156753 Apr 12 16:18:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 306/923] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:18:42 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 1493 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-100ac970-4262-458f-8c89-4e7dfe80e049 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046466 Apr 12 16:18:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 308/924] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:18:44 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e10b2d66-b8c0-4332-b262-72786fea9f15"}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:47 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-679ecd3e-5491-4468-8eb9-5f1c6ed8bdad tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341737 Apr 12 16:18:47 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 311/925] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:18:46 2023] POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 194 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:54 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'services' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:18:54 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-7250612f-a469-442d-851e-9f53fc70a34e tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/e10b2d66-b8c0-4332-b262-72786fea9f15" status: 202 len: 0 microversion: 2.1 time: 0.155959 Apr 12 16:18:54 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 307/926] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:18:53 2023] DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/e10b2d66-b8c0-4332-b262-72786fea9f15 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:54 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fe84fe7e-86e2-45d1-877b-101bd6a42098 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052826 Apr 12 16:18:54 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 309/927] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:18:54 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:55 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-810ed35c-342b-4918-aa11-59b9439abca5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1656 microversion: 2.1 time: 0.156635 Apr 12 16:18:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 312/928] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:18:55 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1656 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: f52ee906-c8fd-4cd5-842e-de98a5099c4f] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HTTP exception thrown: Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f could not be found. Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Request method failure captured: Apr 12 16:18:59 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f HTTP/1.1 Apr 12 16:18:59 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:18:59 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:18:59 user devstack@n-api.service[61659]: Connection: close Apr 12 16:18:59 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:18:59 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:18:59 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:18:59 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:18:59 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVYYBXv3KMlc-Z7sQF-RkZWC2YP3S9HWAy7Hok1TmTYJjbK2C90ck9c7nWqj2YiVgqcl7U6sTwx8t8ucFrBvgc33dcU9tw-vXDrUzvXnRKG64BjxA6fAjqqFs3NuEu1WA1mlzLTV0BLb4GGP9WZSMDyldJ5id3caWuZz9p308d737Q Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Project-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9210f81232304e179d3e09914a492442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Tenant-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:18:59 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:18:59 user devstack@n-api.service[61659]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:18:59 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:18:59 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:18:59 user devstack@n-api.service[61659]: X-User-Id: 73f9fa5bc22a4824b3cdcb8cf7bb380c Apr 12 16:18:59 user devstack@n-api.service[61659]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:18:59 user devstack@n-api.service[61659]: method: > Apr 12 16:18:59 user devstack@n-api.service[61659]: exception: Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f could not be found. Apr 12 16:18:59 user devstack@n-api.service[61659]: action_args: {'id': 'f52ee906-c8fd-4cd5-842e-de98a5099c4f'} Apr 12 16:18:59 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f could not be found. Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f could not be found. Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f could not be found. Apr 12 16:18:59 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Returning 404 to user: Instance f52ee906-c8fd-4cd5-842e-de98a5099c4f could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:18:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-4183924e-bf88-4210-9907-fa5aa6624c44 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f" status: 404 len: 111 microversion: 2.87 time: 0.029365 Apr 12 16:18:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 308/929] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:18:59 2023] GET /compute/v2.1/servers/f52ee906-c8fd-4cd5-842e-de98a5099c4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:18:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-225ef27c-d938-4e86-b656-374268696f47 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001" status: 204 len: 0 microversion: 2.87 time: 0.120317 Apr 12 16:18:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 310/930] 10.0.0.210 () {64 vars in 1357 bytes} [Wed Apr 12 16:18:59 2023] DELETE /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:59 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '73f9fa5bc22a4824b3cdcb8cf7bb380c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9210f81232304e179d3e09914a492442', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:18:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c3d5a234-3947-40e3-9784-47b9c7ce27d3 tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001" status: 200 len: 1697 microversion: 2.87 time: 0.192269 Apr 12 16:18:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 313/931] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:18:59 2023] GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608fbea2-b42b-4bb9-94a7-2b76dcdc2001", "name": "network-vif-unplugged", "status": "completed", "tag": "246d47a5-6953-4e38-8546-63953a8721cf"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:18:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:18:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] Creating event network-vif-unplugged:246d47a5-6953-4e38-8546-63953a8721cf for instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 on user Apr 12 16:18:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-eb6db9dc-4769-4496-980e-1ea8abf80368 req-40d39c9b-a115-435b-b4a0-f584c9bd18c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027866 Apr 12 16:18:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 309/932] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:18:59 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:01 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-341f4298-2c6c-4e8d-8b7c-833c63447b98 req-826dc099-725a-421f-a5d3-0694a9c664a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608fbea2-b42b-4bb9-94a7-2b76dcdc2001", "name": "network-vif-deleted", "tag": "246d47a5-6953-4e38-8546-63953a8721cf"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-341f4298-2c6c-4e8d-8b7c-833c63447b98 req-826dc099-725a-421f-a5d3-0694a9c664a9 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-341f4298-2c6c-4e8d-8b7c-833c63447b98 req-826dc099-725a-421f-a5d3-0694a9c664a9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-341f4298-2c6c-4e8d-8b7c-833c63447b98 req-826dc099-725a-421f-a5d3-0694a9c664a9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-341f4298-2c6c-4e8d-8b7c-833c63447b98 req-826dc099-725a-421f-a5d3-0694a9c664a9 service nova] Creating event network-vif-deleted:246d47a5-6953-4e38-8546-63953a8721cf for instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 on user Apr 12 16:19:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-341f4298-2c6c-4e8d-8b7c-833c63447b98 req-826dc099-725a-421f-a5d3-0694a9c664a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033460 Apr 12 16:19:01 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 311/933] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:01 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "608fbea2-b42b-4bb9-94a7-2b76dcdc2001", "name": "network-vif-plugged", "status": "completed", "tag": "246d47a5-6953-4e38-8546-63953a8721cf"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] Creating event network-vif-plugged:246d47a5-6953-4e38-8546-63953a8721cf for instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 on user Apr 12 16:19:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-dccd3a43-fb7b-4012-9f45-47fe2a69644e req-9a5f22ac-dc67-446f-a0e8-e16efa7d4c24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030408 Apr 12 16:19:01 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 314/934] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:03 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:03 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-be03cbd8-cc0a-4f78-a7e2-483652eac22d tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.237277 Apr 12 16:19:03 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 310/935] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:19:03 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments => generated 25 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] HTTP exception thrown: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 is not attached to volume 63821959-5dfd-4f66-a6e5-90a20b30efab Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Request method failure captured: Apr 12 16:19:03 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments/63821959-5dfd-4f66-a6e5-90a20b30efab HTTP/1.1 Apr 12 16:19:03 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:19:03 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:19:03 user devstack@n-api.service[61657]: Connection: close Apr 12 16:19:03 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:19:03 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:19:03 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:19:03 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:19:03 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtdrPOEzq3NajGVio9y9Dtg1Ox8thkhzem7Nq1fBGQAzfZuOtOYBI1KDTxCByAg-s35vdnS3hlpPPN-tTXWeYvt5dhklovFZmL6sE_ooacxs7YWNGmJkg48xgOaF3ibSfUnWe2Px0E76EwM6IqXotkdqINcSLchI5RcFB-9TdNnFYL0 Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Project-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/236b9e609eb44071bc88971bff96931e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Tenant: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Tenant-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:19:03 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:19:03 user devstack@n-api.service[61657]: X-User: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:19:03 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:19:03 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:19:03 user devstack@n-api.service[61657]: X-User-Id: 16a68fa3490940ebaebc8d4ca5746f6e Apr 12 16:19:03 user devstack@n-api.service[61657]: X-User-Name: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:19:03 user devstack@n-api.service[61657]: method: > Apr 12 16:19:03 user devstack@n-api.service[61657]: exception: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 is not attached to volume 63821959-5dfd-4f66-a6e5-90a20b30efab Apr 12 16:19:03 user devstack@n-api.service[61657]: action_args: {'server_id': 'b4c37cbf-1743-4dd5-97fd-2bb12ebee763', 'id': '63821959-5dfd-4f66-a6e5-90a20b30efab'} Apr 12 16:19:03 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 63821959-5dfd-4f66-a6e5-90a20b30efab. Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 is not attached to volume 63821959-5dfd-4f66-a6e5-90a20b30efab Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 is not attached to volume 63821959-5dfd-4f66-a6e5-90a20b30efab Apr 12 16:19:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Returning 404 to user: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 is not attached to volume 63821959-5dfd-4f66-a6e5-90a20b30efab {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:19:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-28dbe6c2-9d93-42b0-9fc6-87109e9ab6bb tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments/63821959-5dfd-4f66-a6e5-90a20b30efab" status: 404 len: 154 microversion: 2.1 time: 0.089854 Apr 12 16:19:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 312/936] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:19:03 2023] DELETE /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763/os-volume_attachments/63821959-5dfd-4f66-a6e5-90a20b30efab => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:05 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:19:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-77dea899-66d2-4bb4-a743-f030350017b1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 200 len: 1393 microversion: 2.1 time: 0.154122 Apr 12 16:19:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 315/937] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:19:05 2023] GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:06 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:19:06 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-bdb1b1f9-5efc-4654-aa9f-a0af8682ed27 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 204 len: 0 microversion: 2.1 time: 0.118325 Apr 12 16:19:06 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 311/938] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:19:05 2023] DELETE /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:06 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16a68fa3490940ebaebc8d4ca5746f6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '236b9e609eb44071bc88971bff96931e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:19:06 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-4e096adf-7180-4aed-b238-8a9414079b90 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 200 len: 1542 microversion: 2.1 time: 0.214492 Apr 12 16:19:06 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 313/939] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:19:06 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 1542 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:06 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-unplugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:06 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] Creating event network-vif-unplugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:19:06 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-3b109d4b-6ed3-48f1-b575-2b670b5b7c70 req-817e9dae-0aac-4d13-9109-0dc314042cde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029236 Apr 12 16:19:06 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 316/940] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-deleted", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] Creating event network-vif-deleted:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:19:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-96d20422-e5a6-4c9b-84a6-1b869d9a7198 req-978d8f96-317a-4177-ab2b-491b680f9d8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030623 Apr 12 16:19:07 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 312/941] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4c37cbf-1743-4dd5-97fd-2bb12ebee763", "name": "network-vif-plugged", "status": "completed", "tag": "d023dabe-13d5-4bbb-aa87-e9c1f5f1a048"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] Creating event network-vif-plugged:d023dabe-13d5-4bbb-aa87-e9c1f5f1a048 for instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 on user Apr 12 16:19:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3f1216e0-3796-4d6d-acc8-8e566684f030 req-0d1b280e-f2e3-4ed4-a524-dbfe2deb2ad1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Apr 12 16:19:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 314/942] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=14 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:28 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:28 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b3670cb8-ae89-4336-939f-60ae28ae704b tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/action" status: 204 len: 0 microversion: 2.1 time: 0.081264 Apr 12 16:19:28 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 317/943] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:19:28 2023] POST /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/action => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:28 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:19:28 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-9fc8f57f-4ba7-4f16-b095-a5e60e815dbd tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1555 microversion: 2.1 time: 0.264323 Apr 12 16:19:28 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 313/944] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:19:28 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1555 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7c49e498-01b7-44ca-8dfe-a9b8078c40ea tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.186201 Apr 12 16:19:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 315/945] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:19:44 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 25 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:19:44 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:44 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-87062abb-836b-495a-a0ae-954cc9e37c25 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2014173698", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "destination_type": "local"}, {"source_type": "volume", "uuid": "5b8d70b8-8989-4dc3-9ea4-ebffeee14e66", "destination_type": "invalid"}], "networks": [{"uuid": "89a33fcd-81e9-4815-8644-d9b33ceb236b"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-87062abb-836b-495a-a0ae-954cc9e37c25 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Request method failure captured: Apr 12 16:19:44 user devstack@n-api.service[61658]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 12 16:19:44 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:19:44 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:19:44 user devstack@n-api.service[61658]: Connection: close Apr 12 16:19:44 user devstack@n-api.service[61658]: Content-Length: 494 Apr 12 16:19:44 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:19:44 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:19:44 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:19:44 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNthXKmRzGDp6W7hfu3MsqU660viKFJPVHYOmmVh5q4O21qCwXBst4UFVtIETOWZXw0cOYzX7lGyhKCYl45iEXdmdHXx7g3ZUuVMLJSC4B1gpA-yGjT2NM8Z6HYXsIpYCt2xoBsAth2xe2V6xcA9_fTAABjy7k-K8qpDQ2CYfLMIdNBU Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Project-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Tenant: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Tenant-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:19:44 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:19:44 user devstack@n-api.service[61658]: X-User: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:19:44 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:19:44 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:19:44 user devstack@n-api.service[61658]: X-User-Id: 38c60e84c47047e2886220f2ef54391d Apr 12 16:19:44 user devstack@n-api.service[61658]: X-User-Name: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:19:44 user devstack@n-api.service[61658]: Apr 12 16:19:44 user devstack@n-api.service[61658]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2014173698", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "destination_type": "local"}, {"source_type": "volume", "uuid": "5b8d70b8-8989-4dc3-9ea4-ebffeee14e66", "destination_type": "invalid"}], "networks": [{"uuid": "89a33fcd-81e9-4815-8644-d9b33ceb236b"}]}} Apr 12 16:19:44 user devstack@n-api.service[61658]: method: > Apr 12 16:19:44 user devstack@n-api.service[61658]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 16:19:44 user devstack@n-api.service[61658]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2014173698', 'imageRef': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '9dc63f14-8b70-4e72-89f2-13464f2f5c7c', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '5b8d70b8-8989-4dc3-9ea4-ebffeee14e66', 'destination_type': 'invalid'}], 'networks': [{'uuid': '89a33fcd-81e9-4815-8644-d9b33ceb236b'}]}}} Apr 12 16:19:44 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise error Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi 'invalid' Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 12 16:19:44 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-87062abb-836b-495a-a0ae-954cc9e37c25 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:19:44 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-87062abb-836b-495a-a0ae-954cc9e37c25 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.018669 Apr 12 16:19:44 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 318/946] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:19:44 2023] POST /compute/v2.1/servers => generated 155 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:44 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:19:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d58edc3e-04ed-44fd-95a9-e4d0ea80913a tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 200 len: 1493 microversion: 2.1 time: 0.148986 Apr 12 16:19:44 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 314/947] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:19:44 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 1493 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0b87cf1-91fb-4365-9356-8aab68a15e7e"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:47 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-112f0937-728c-4451-887c-cbf3aab2e56a tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.427361 Apr 12 16:19:47 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 316/948] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:19:46 2023] POST /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] [instance: 608fbea2-b42b-4bb9-94a7-2b76dcdc2001] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] HTTP exception thrown: Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 could not be found. Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Request method failure captured: Apr 12 16:19:49 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001 HTTP/1.1 Apr 12 16:19:49 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:19:49 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:19:49 user devstack@n-api.service[61658]: Connection: close Apr 12 16:19:49 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:19:49 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:19:49 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:19:49 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:19:49 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVYYBXv3KMlc-Z7sQF-RkZWC2YP3S9HWAy7Hok1TmTYJjbK2C90ck9c7nWqj2YiVgqcl7U6sTwx8t8ucFrBvgc33dcU9tw-vXDrUzvXnRKG64BjxA6fAjqqFs3NuEu1WA1mlzLTV0BLb4GGP9WZSMDyldJ5id3caWuZz9p308d737Q Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Openstack-Nova-Api-Version: 2.87 Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Project-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9210f81232304e179d3e09914a492442"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9210f81232304e179d3e09914a492442"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Tenant-Id: 9210f81232304e179d3e09914a492442 Apr 12 16:19:49 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578 Apr 12 16:19:49 user devstack@n-api.service[61658]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:19:49 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:19:49 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:19:49 user devstack@n-api.service[61658]: X-User-Id: 73f9fa5bc22a4824b3cdcb8cf7bb380c Apr 12 16:19:49 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member Apr 12 16:19:49 user devstack@n-api.service[61658]: method: > Apr 12 16:19:49 user devstack@n-api.service[61658]: exception: Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 could not be found. Apr 12 16:19:49 user devstack@n-api.service[61658]: action_args: {'id': '608fbea2-b42b-4bb9-94a7-2b76dcdc2001'} Apr 12 16:19:49 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 could not be found. Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 could not be found. Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 could not be found. Apr 12 16:19:49 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:19:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] Returning 404 to user: Instance 608fbea2-b42b-4bb9-94a7-2b76dcdc2001 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:19:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6e619503-b680-4213-930e-94d532caa33f tempest-ServerBootFromVolumeStableRescueTest-1443944578 tempest-ServerBootFromVolumeStableRescueTest-1443944578-project-member] 10.0.0.210 "GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001" status: 404 len: 111 microversion: 2.87 time: 0.038137 Apr 12 16:19:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 319/949] 10.0.0.210 () {64 vars in 1354 bytes} [Wed Apr 12 16:19:49 2023] GET /compute/v2.1/servers/608fbea2-b42b-4bb9-94a7-2b76dcdc2001 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:55 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lazy-loading 'services' on Instance uuid 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:19:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-377952d4-ba38-4380-afbb-052444672c63 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/f0b87cf1-91fb-4365-9356-8aab68a15e7e" status: 202 len: 0 microversion: 2.1 time: 0.194278 Apr 12 16:19:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 315/950] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:19:55 2023] DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments/f0b87cf1-91fb-4365-9356-8aab68a15e7e => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:55 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:55 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3b687db6-92c6-480b-a72f-8e1c63d74e1f tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042420 Apr 12 16:19:55 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 317/951] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:19:55 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6fee1cce-f565-4395-9ca7-5a6bc9e07dd9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048386 Apr 12 16:19:56 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 320/952] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:19:56 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] [instance: b4c37cbf-1743-4dd5-97fd-2bb12ebee763] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] HTTP exception thrown: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 could not be found. Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Request method failure captured: Apr 12 16:19:56 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 HTTP/1.1 Apr 12 16:19:56 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:19:56 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:19:56 user devstack@n-api.service[61657]: Connection: close Apr 12 16:19:56 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:19:56 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:19:56 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:19:56 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:19:56 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtdrPOEzq3NajGVio9y9Dtg1Ox8thkhzem7Nq1fBGQAzfZuOtOYBI1KDTxCByAg-s35vdnS3hlpPPN-tTXWeYvt5dhklovFZmL6sE_ooacxs7YWNGmJkg48xgOaF3ibSfUnWe2Px0E76EwM6IqXotkdqINcSLchI5RcFB-9TdNnFYL0 Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Project-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/236b9e609eb44071bc88971bff96931e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/236b9e609eb44071bc88971bff96931e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Tenant: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Tenant-Id: 236b9e609eb44071bc88971bff96931e Apr 12 16:19:56 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1374695003 Apr 12 16:19:56 user devstack@n-api.service[61657]: X-User: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:19:56 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:19:56 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:19:56 user devstack@n-api.service[61657]: X-User-Id: 16a68fa3490940ebaebc8d4ca5746f6e Apr 12 16:19:56 user devstack@n-api.service[61657]: X-User-Name: tempest-TestMinimumBasicScenario-1374695003-project-member Apr 12 16:19:56 user devstack@n-api.service[61657]: method: > Apr 12 16:19:56 user devstack@n-api.service[61657]: exception: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 could not be found. Apr 12 16:19:56 user devstack@n-api.service[61657]: action_args: {'id': 'b4c37cbf-1743-4dd5-97fd-2bb12ebee763'} Apr 12 16:19:56 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 could not be found. Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 could not be found. Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 could not be found. Apr 12 16:19:56 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Returning 404 to user: Instance b4c37cbf-1743-4dd5-97fd-2bb12ebee763 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:19:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-38f1c31b-308f-4eb9-9b3f-044cdb72e95e tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763" status: 404 len: 111 microversion: 2.1 time: 0.032890 Apr 12 16:19:56 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 318/953] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:19:56 2023] GET /compute/v2.1/servers/b4c37cbf-1743-4dd5-97fd-2bb12ebee763 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e26967a1-da99-4f0f-a97e-e0caa4840f50 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] Calling method '.version_select at 0x7fdee7702200>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:56 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:19:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e26967a1-da99-4f0f-a97e-e0caa4840f50 tempest-TestMinimumBasicScenario-1374695003 tempest-TestMinimumBasicScenario-1374695003-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1912647637" status: 202 len: 0 microversion: 2.1 time: 0.027050 Apr 12 16:19:56 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 321/954] 10.0.0.210 () {62 vars in 1349 bytes} [Wed Apr 12 16:19:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1912647637 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:19:56 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8788920f-134f-47f0-979a-8cc5046dfa4a tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 204 len: 0 microversion: 2.1 time: 0.151087 Apr 12 16:19:56 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 316/955] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:19:56 2023] DELETE /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:19:56 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-aea7172f-cd10-48bb-ad80-604a1edad93e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 200 len: 1662 microversion: 2.1 time: 0.220299 Apr 12 16:19:56 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 319/956] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:19:56 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 1662 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-unplugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] Creating event network-vif-unplugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:19:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-08859f6d-2d27-4348-8982-292bf827cec3 req-e03683d1-cc28-4f93-80b3-36be683eae01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066163 Apr 12 16:19:56 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 322/957] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-deleted", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] Creating event network-vif-deleted:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:19:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-18c4f2e0-773a-4f9b-ab45-f306fd6f6b78 req-8527ed51-55cf-4f2e-bd51-0344eece08c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033726 Apr 12 16:19:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 317/958] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:19:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4190e244-84b1-47b6-813d-9cadb7c65975", "name": "network-vif-plugged", "status": "completed", "tag": "eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:19:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:19:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:19:58 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:19:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] Creating event network-vif-plugged:eab1ea0c-8a7c-46dd-8b44-1ef5aceeb98c for instance 4190e244-84b1-47b6-813d-9cadb7c65975 on user Apr 12 16:19:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-9aefbc21-7287-4341-b800-949963215a2b req-d0e72188-50d2-4408-8341-8d7294a12f4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047307 Apr 12 16:19:58 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 320/959] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:19:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:05 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:20:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-32fe26f1-5d2d-4efa-a229-77549bd73ab1 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 200 len: 1393 microversion: 2.1 time: 0.166917 Apr 12 16:20:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 323/960] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:05 2023] GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1169753440"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:05 user devstack@n-api.service[61659]: INFO nova.compute.api [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Attempting to quiesce instance before volume snapshot. Apr 12 16:20:05 user devstack@n-api.service[61659]: INFO nova.compute.api [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 12 16:20:05 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Creating snapshot from volume 952c0ad3-7b56-454e-af58-10213195373d. {{(pid=61659) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 12 16:20:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a11eb01e-ef4b-46a1-a3b0-1f452b6d4d45 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31/action" status: 202 len: 0 microversion: 2.1 time: 3.071564 Apr 12 16:20:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 318/961] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:20:05 2023] POST /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31/action => generated 0 bytes in 3073 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=12 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1807466168", "imageRef": "85e3d4b3-113c-46c2-9365-bfa680ff8338", "flavorRef": "42", "networks": [{"uuid": "1439244b-8287-4bba-a88c-99d4b498cccd"}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] validate_networks() for [('1439244b-8287-4bba-a88c-99d4b498cccd', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for user 7054687447fc42339e9046ced4915890 and project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:20:09 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b3b07d81-9f28-4168-8209-3eaf44f37a1f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:20:09 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7b6a2f79-26cd-4754-a92d-3a5e572ad092 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.737334 Apr 12 16:20:09 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 321/962] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:20:09 2023] POST /compute/v2.1/servers => generated 378 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:20:09 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3f88928f-945f-49d5-bcfd-33ff4cb36af3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:09 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-3f88928f-945f-49d5-bcfd-33ff4cb36af3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:09 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-3f88928f-945f-49d5-bcfd-33ff4cb36af3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:20:09 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-3f88928f-945f-49d5-bcfd-33ff4cb36af3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 200 len: 1224 microversion: 2.1 time: 0.080888 Apr 12 16:20:09 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 324/963] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:09 2023] GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:12 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb6ec19f-61e7-43af-92d7-44fbf8535d04", "tag": "b392629c-5b31-400b-be14-aa168e45f717"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:12 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] Creating event network-changed:b392629c-5b31-400b-be14-aa168e45f717 for instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 on user Apr 12 16:20:12 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-8da40804-9f87-4da0-a77c-fa66e07e3ad1 req-caa125b7-487b-4e7f-be08-27c5ac9578d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030535 Apr 12 16:20:12 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 319/964] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:18 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:20:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-14a26192-37f9-4a70-a0d4-7575f4d7cb07 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1547 microversion: 2.1 time: 0.161191 Apr 12 16:20:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 322/965] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:18 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1547 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ec19f-61e7-43af-92d7-44fbf8535d04", "name": "network-vif-plugged", "status": "completed", "tag": "b392629c-5b31-400b-be14-aa168e45f717"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=16 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] Creating event network-vif-plugged:b392629c-5b31-400b-be14-aa168e45f717 for instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 on user Apr 12 16:20:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-f67d2611-4495-4e20-8a63-500d672fe1d0 req-e6ca222a-9324-42dd-bbe5-ab6a44ad49db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043160 Apr 12 16:20:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 325/966] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ec19f-61e7-43af-92d7-44fbf8535d04", "name": "network-vif-plugged", "status": "completed", "tag": "b392629c-5b31-400b-be14-aa168e45f717"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=42,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] Creating event network-vif-plugged:b392629c-5b31-400b-be14-aa168e45f717 for instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 on user Apr 12 16:20:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-5b880a91-6d60-4cd6-9ffa-9bd48202f1f6 req-93d6f4f6-8317-4da1-b260-3a06c071adff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121560 Apr 12 16:20:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 320/967] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=8 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-92aa68eb-1c61-41cd-8ad6-c07175b41898 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054055 Apr 12 16:20:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 323/968] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:20:45 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HTTP exception thrown: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Request method failure captured: Apr 12 16:20:46 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 HTTP/1.1 Apr 12 16:20:46 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:20:46 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:20:46 user devstack@n-api.service[61658]: Connection: close Apr 12 16:20:46 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:20:46 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:20:46 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:20:46 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:20:46 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtfyRm3HaVmM3PkhKndzmXYHQY_-2jlWf0xpf2TMiUB5pJVUa1PqOynC5D6b1KrencTuNR7cl8Dr4C82YH8-MXsF8bVg5gjgnAB0BpNc2-kXQR2mX7onFNEYAsy_U9zz_-g_xvFpqNEpdEouwLCcQmwQ2veiJvWKNm1shOLfB0rm8eo Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Project-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Tenant-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:20:46 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:20:46 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:20:46 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:20:46 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:20:46 user devstack@n-api.service[61658]: X-User-Id: 2996f6997bb14fc3aec9c3736cc65b8a Apr 12 16:20:46 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:20:46 user devstack@n-api.service[61658]: method: > Apr 12 16:20:46 user devstack@n-api.service[61658]: exception: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:20:46 user devstack@n-api.service[61658]: action_args: {'id': '4190e244-84b1-47b6-813d-9cadb7c65975'} Apr 12 16:20:46 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:20:46 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Returning 404 to user: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:20:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-6edd967f-8c79-4145-8701-b41f215ba863 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 404 len: 111 microversion: 2.1 time: 0.037348 Apr 12 16:20:46 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 326/969] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:46 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:20:46 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b9cd891d-2f3a-4c3e-84ef-30bdd3065f82 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '.version_select at 0x7fdee772b760>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b9cd891d-2f3a-4c3e-84ef-30bdd3065f82 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295229303" status: 202 len: 0 microversion: 2.1 time: 0.037764 Apr 12 16:20:46 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 321/970] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 16:20:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295229303 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:20:47 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-31a27160-48a0-4295-823f-87dadaeca4d5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'create', calling method: .version_select at 0x7fdee7714040>, body: {"keypair": {"name": "tempest-keypair-857316521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFegUIJydsU75qcTJSV45dkY83seloCWf7obTREoxQ5Tzm2UtnqJnKrcKtlka/HBhmbE6gwOWBaksH9phh2mET8aWcIhrLEtEDmJocz9/pW3fFh7UqcEP6/AzD4YnExbQA=="}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:47 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-31a27160-48a0-4295-823f-87dadaeca4d5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:20:47 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-31a27160-48a0-4295-823f-87dadaeca4d5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for user 2996f6997bb14fc3aec9c3736cc65b8a and project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'key_pairs'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:20:47 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-31a27160-48a0-4295-823f-87dadaeca4d5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052530 Apr 12 16:20:47 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 324/971] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:20:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1694219693", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1ef428ff-90e5-4abd-93d0-b7c2c581cb26"}], "security_groups": [{"name": "tempest-securitygroup--927220548"}], "key_name": "tempest-keypair-857316521", "user_data": "}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:49 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] validate_networks() for [('1ef428ff-90e5-4abd-93d0-b7c2c581cb26', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Getting quotas for user 2996f6997bb14fc3aec9c3736cc65b8a and project 7cf4334df004490ba51b4d92ce5408ae. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:20:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-dd8fd665-654f-4fa0-8e55-03f97cbbff9d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.904295 Apr 12 16:20:50 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 327/972] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:20:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1674f187-4816-4ec6-b662-2b1dccab0b26 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1674f187-4816-4ec6-b662-2b1dccab0b26 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-1674f187-4816-4ec6-b662-2b1dccab0b26 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:20:50 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1674f187-4816-4ec6-b662-2b1dccab0b26 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b" status: 200 len: 1231 microversion: 2.1 time: 0.083022 Apr 12 16:20:50 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 322/973] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:50 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b => generated 1231 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] HTTP exception thrown: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Request method failure captured: Apr 12 16:20:50 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e HTTP/1.1 Apr 12 16:20:50 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:20:50 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:20:50 user devstack@n-api.service[61657]: Connection: close Apr 12 16:20:50 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:20:50 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:20:50 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:20:50 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:20:50 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNthXKmRzGDp6W7hfu3MsqU660viKFJPVHYOmmVh5q4O21qCwXBst4UFVtIETOWZXw0cOYzX7lGyhKCYl45iEXdmdHXx7g3ZUuVMLJSC4B1gpA-yGjT2NM8Z6HYXsIpYCt2xoBsAth2xe2V6xcA9_fTAABjy7k-K8qpDQ2CYfLMIdNBU Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Project-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Project-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Tenant: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Tenant-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:20:50 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:20:50 user devstack@n-api.service[61657]: X-User: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:20:50 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:20:50 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:20:50 user devstack@n-api.service[61657]: X-User-Id: 38c60e84c47047e2886220f2ef54391d Apr 12 16:20:50 user devstack@n-api.service[61657]: X-User-Name: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:20:50 user devstack@n-api.service[61657]: method: > Apr 12 16:20:50 user devstack@n-api.service[61657]: exception: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61657]: action_args: {'id': '947c2ca9-fd67-4e8d-b0dc-90c5c827a59e'} Apr 12 16:20:50 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Returning 404 to user: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:20:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d362d590-1069-45f6-b05d-56ec1081adac tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" status: 404 len: 111 microversion: 2.1 time: 0.045772 Apr 12 16:20:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 325/974] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:20:50 2023] DELETE /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] HTTP exception thrown: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Request method failure captured: Apr 12 16:20:50 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e HTTP/1.1 Apr 12 16:20:50 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:20:50 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:20:50 user devstack@n-api.service[61658]: Connection: close Apr 12 16:20:50 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:20:50 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:20:50 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:20:50 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:20:50 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNthXKmRzGDp6W7hfu3MsqU660viKFJPVHYOmmVh5q4O21qCwXBst4UFVtIETOWZXw0cOYzX7lGyhKCYl45iEXdmdHXx7g3ZUuVMLJSC4B1gpA-yGjT2NM8Z6HYXsIpYCt2xoBsAth2xe2V6xcA9_fTAABjy7k-K8qpDQ2CYfLMIdNBU Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Project-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Tenant: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Tenant-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:20:50 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:20:50 user devstack@n-api.service[61658]: X-User: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:20:50 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:20:50 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:20:50 user devstack@n-api.service[61658]: X-User-Id: 38c60e84c47047e2886220f2ef54391d Apr 12 16:20:50 user devstack@n-api.service[61658]: X-User-Name: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:20:50 user devstack@n-api.service[61658]: method: > Apr 12 16:20:50 user devstack@n-api.service[61658]: exception: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61658]: action_args: {'id': '947c2ca9-fd67-4e8d-b0dc-90c5c827a59e'} Apr 12 16:20:50 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. Apr 12 16:20:50 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Returning 404 to user: Instance 947c2ca9-fd67-4e8d-b0dc-90c5c827a59e could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:20:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-3106fba9-8c38-444e-afb2-ab5640655de8 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e" status: 404 len: 111 microversion: 2.1 time: 0.034442 Apr 12 16:20:50 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 328/975] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:50 2023] GET /compute/v2.1/servers/947c2ca9-fd67-4e8d-b0dc-90c5c827a59e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:20:50 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-79af718b-a39a-45a4-8f8e-68d384353932 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 204 len: 0 microversion: 2.1 time: 0.148975 Apr 12 16:20:50 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 323/976] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:20:50 2023] DELETE /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38c60e84c47047e2886220f2ef54391d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280a9a56afca4ce591faca7a94eca4b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:20:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-f701a866-9ea5-4f30-9080-f727f33f231e tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 200 len: 1499 microversion: 2.1 time: 0.181872 Apr 12 16:20:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 326/977] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:50 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 1499 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b613235-a905-466f-b9cc-a21a321a6313", "name": "network-vif-unplugged", "status": "completed", "tag": "8a0b8df5-77c2-4888-b715-9f4bafba36b9"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] Creating event network-vif-unplugged:8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance 1b613235-a905-466f-b9cc-a21a321a6313 on user Apr 12 16:20:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-077075c3-1199-4dc8-8121-32774f7d93f8 req-15ce681f-1cbd-4616-b601-e589a1cdb411 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166366 Apr 12 16:20:50 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 329/978] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:50 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:52 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b613235-a905-466f-b9cc-a21a321a6313", "name": "network-vif-plugged", "status": "completed", "tag": "8a0b8df5-77c2-4888-b715-9f4bafba36b9"}, {"server_uuid": "1b613235-a905-466f-b9cc-a21a321a6313", "name": "network-vif-deleted", "tag": "8a0b8df5-77c2-4888-b715-9f4bafba36b9"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:52 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Creating event network-vif-plugged:8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance 1b613235-a905-466f-b9cc-a21a321a6313 on user Apr 12 16:20:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] Creating event network-vif-deleted:8a0b8df5-77c2-4888-b715-9f4bafba36b9 for instance 1b613235-a905-466f-b9cc-a21a321a6313 on user Apr 12 16:20:52 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-de784852-e3a3-4cc8-bd00-ec662e685be5 req-7ad62510-452e-4493-aabf-87df23a2efa3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030002 Apr 12 16:20:52 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 324/979] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:54 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:54 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:54 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] Creating event network-changed:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:20:54 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-f8f464c2-4ba8-424f-9dfd-83d8fa3b9f16 req-cbc7361e-90c9-4481-83eb-b9a10f73454f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094624 Apr 12 16:20:54 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 327/980] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:56 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-plugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:56 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] Creating event network-vif-plugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:20:56 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-6b992eb4-711c-4e5a-96fd-3125f543c777 req-801adc32-3c3b-441d-8052-729cb6b689da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Apr 12 16:20:56 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 330/981] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-plugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:20:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] Creating event network-vif-plugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:20:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-dc1bb31e-37cf-4d5a-bba3-c233af00a211 req-0cdc7c24-698c-4c41-84b6-38c3c0be86ac service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030864 Apr 12 16:20:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 325/982] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:20:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:20:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:00 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:21:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-42242053-249e-4225-8e02-bdc546942ead tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 200 len: 1551 microversion: 2.1 time: 0.171975 Apr 12 16:21:00 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 328/983] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:20:59 2023] GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 1551 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:04 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:04 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] Creating event network-changed:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:21:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d8c10a75-6ca1-4d90-bb55-33afae0a0764 req-fc2627c3-9db3-4a66-b805-360ae3e1eced service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038302 Apr 12 16:21:04 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 331/984] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:21:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:07 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:21:07 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-0e4660f4-be92-46c8-96b9-3a201faa3f3b tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5" status: 204 len: 0 microversion: 2.1 time: 0.121300 Apr 12 16:21:07 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 326/985] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:21:07 2023] DELETE /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:07 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:08 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3823da50be004112aaa5ee35b724c6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d8082517724895a2027594f440071d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:21:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7c99f1a7-4c06-4d9c-926c-58a2cb0df954 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5" status: 200 len: 1572 microversion: 2.1 time: 0.278010 Apr 12 16:21:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 329/986] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:21:07 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => generated 1572 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "name": "network-vif-unplugged", "status": "completed", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] Creating event network-vif-unplugged:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:21:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-0f00b49d-c297-4027-8829-c52e7581c257 req-b653f051-c882-4d5c-afaf-2dcae2d640cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031467 Apr 12 16:21:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 332/987] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:21:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "name": "network-vif-plugged", "status": "completed", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}, {"server_uuid": "540a8fd5-8c18-4efe-97d4-9f0942cebcf5", "name": "network-vif-deleted", "tag": "be492426-cc7d-4f76-80a2-ab97d8733e58"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Creating event network-vif-plugged:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:21:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] Creating event network-vif-deleted:be492426-cc7d-4f76-80a2-ab97d8733e58 for instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 on user Apr 12 16:21:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-1f477cc1-8afc-4e97-a21a-23d40fcfec30 req-9a01e3ae-9295-4cd6-9e1f-913476ba8f03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.063119 Apr 12 16:21:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 327/988] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:21:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=28 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:19 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:21:19 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c0ff7ff0-83e8-4a34-b8c4-ecf80107ffde tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1547 microversion: 2.1 time: 0.402649 Apr 12 16:21:19 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 330/989] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:21:18 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1547 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=14 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:19 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5e7e1259-eba1-410f-8674-2d2edab26814 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "POST /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/action" status: 200 len: 28542 microversion: 2.1 time: 0.241547 Apr 12 16:21:19 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 333/990] 10.0.0.210 () {64 vars in 1355 bytes} [Wed Apr 12 16:21:19 2023] POST /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567/action => generated 28542 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:19 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:21:19 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a693a456-4a0c-4ab7-9846-badc30613d3a tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976" status: 200 len: 1539 microversion: 2.1 time: 0.213917 Apr 12 16:21:19 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 328/991] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:21:19 2023] GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976 => generated 1539 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:40 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:21:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-ac7c37c2-5621-42db-84d6-42ffbfcdac10 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b" status: 200 len: 1535 microversion: 2.1 time: 0.362257 Apr 12 16:21:40 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 331/992] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:21:40 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b => generated 1535 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] [instance: 1b613235-a905-466f-b9cc-a21a321a6313] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] HTTP exception thrown: Instance 1b613235-a905-466f-b9cc-a21a321a6313 could not be found. Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Request method failure captured: Apr 12 16:21:40 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 HTTP/1.1 Apr 12 16:21:40 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:21:40 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:21:40 user devstack@n-api.service[61658]: Connection: close Apr 12 16:21:40 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:21:40 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:21:40 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:21:40 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:21:40 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNthXKmRzGDp6W7hfu3MsqU660viKFJPVHYOmmVh5q4O21qCwXBst4UFVtIETOWZXw0cOYzX7lGyhKCYl45iEXdmdHXx7g3ZUuVMLJSC4B1gpA-yGjT2NM8Z6HYXsIpYCt2xoBsAth2xe2V6xcA9_fTAABjy7k-K8qpDQ2CYfLMIdNBU Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Project-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280a9a56afca4ce591faca7a94eca4b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Tenant: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Tenant-Id: 280a9a56afca4ce591faca7a94eca4b2 Apr 12 16:21:40 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServersNegativeTestJSON-2057017930 Apr 12 16:21:40 user devstack@n-api.service[61658]: X-User: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:21:40 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:21:40 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:21:40 user devstack@n-api.service[61658]: X-User-Id: 38c60e84c47047e2886220f2ef54391d Apr 12 16:21:40 user devstack@n-api.service[61658]: X-User-Name: tempest-ServersNegativeTestJSON-2057017930-project-member Apr 12 16:21:40 user devstack@n-api.service[61658]: method: > Apr 12 16:21:40 user devstack@n-api.service[61658]: exception: Instance 1b613235-a905-466f-b9cc-a21a321a6313 could not be found. Apr 12 16:21:40 user devstack@n-api.service[61658]: action_args: {'id': '1b613235-a905-466f-b9cc-a21a321a6313'} Apr 12 16:21:40 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b613235-a905-466f-b9cc-a21a321a6313 could not be found. Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b613235-a905-466f-b9cc-a21a321a6313 could not be found. Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b613235-a905-466f-b9cc-a21a321a6313 could not be found. Apr 12 16:21:40 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:21:40 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] Returning 404 to user: Instance 1b613235-a905-466f-b9cc-a21a321a6313 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:21:40 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7a84f1df-33bb-4c19-80dc-56c92c983908 tempest-ServersNegativeTestJSON-2057017930 tempest-ServersNegativeTestJSON-2057017930-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313" status: 404 len: 111 microversion: 2.1 time: 0.044083 Apr 12 16:21:40 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 334/993] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:21:40 2023] GET /compute/v2.1/servers/1b613235-a905-466f-b9cc-a21a321a6313 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] [instance: 540a8fd5-8c18-4efe-97d4-9f0942cebcf5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=5 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:21:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] HTTP exception thrown: Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 could not be found. Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Request method failure captured: Apr 12 16:21:58 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5 HTTP/1.1 Apr 12 16:21:58 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:21:58 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:21:58 user devstack@n-api.service[61659]: Connection: close Apr 12 16:21:58 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:21:58 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:21:58 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:21:58 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:21:58 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtjnk_qbegNZAnt3gT8qTL_aqicRoOHsNJE_ZLZDRK_kPOIMVLAz1-B59Ldrj6eogDYULeZZvXFd719-Q3r_y8xuD1RAtVPgHdOV5dcui8DWWuRHAUsDHpYAT_7ATqSSENBAw4Y8PIsLOM87UGs4fTykc9EBjFTMzxIi3Aazmg8IiDQ Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Project-Id: 29d8082517724895a2027594f440071d Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Project-Name: tempest-SnapshotDataIntegrityTests-540489687 Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29d8082517724895a2027594f440071d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29d8082517724895a2027594f440071d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29d8082517724895a2027594f440071d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Tenant: tempest-SnapshotDataIntegrityTests-540489687 Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Tenant-Id: 29d8082517724895a2027594f440071d Apr 12 16:21:58 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-540489687 Apr 12 16:21:58 user devstack@n-api.service[61659]: X-User: tempest-SnapshotDataIntegrityTests-540489687-project-member Apr 12 16:21:58 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:21:58 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:21:58 user devstack@n-api.service[61659]: X-User-Id: 3823da50be004112aaa5ee35b724c6df Apr 12 16:21:58 user devstack@n-api.service[61659]: X-User-Name: tempest-SnapshotDataIntegrityTests-540489687-project-member Apr 12 16:21:58 user devstack@n-api.service[61659]: method: > Apr 12 16:21:58 user devstack@n-api.service[61659]: exception: Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 could not be found. Apr 12 16:21:58 user devstack@n-api.service[61659]: action_args: {'id': '540a8fd5-8c18-4efe-97d4-9f0942cebcf5'} Apr 12 16:21:58 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 could not be found. Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 could not be found. Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 could not be found. Apr 12 16:21:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:21:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Returning 404 to user: Instance 540a8fd5-8c18-4efe-97d4-9f0942cebcf5 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:21:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b56f7bde-aee8-4314-b141-8ed78e933d33 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5" status: 404 len: 111 microversion: 2.1 time: 0.035554 Apr 12 16:21:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 329/994] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:21:58 2023] GET /compute/v2.1/servers/540a8fd5-8c18-4efe-97d4-9f0942cebcf5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:21:58 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-500e210f-93df-4935-92af-a0a3f5682584 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] Calling method '.version_select at 0x7fdee7781c60>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:21:58 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:58 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:21:58 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-500e210f-93df-4935-92af-a0a3f5682584 tempest-SnapshotDataIntegrityTests-540489687 tempest-SnapshotDataIntegrityTests-540489687-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-437348076" status: 202 len: 0 microversion: 2.1 time: 0.029888 Apr 12 16:21:58 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 332/995] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:21:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-437348076 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:22:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-88f03462-a2b9-42d6-a9be-d377b0378ed4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 200 len: 1551 microversion: 2.1 time: 0.184621 Apr 12 16:22:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 335/996] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:22:00 2023] GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 1551 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:00 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:22:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-fe1c29db-9eeb-4200-a4a5-c36b8b73ad0e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 204 len: 0 microversion: 2.1 time: 0.133879 Apr 12 16:22:00 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 330/997] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:22:00 2023] DELETE /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:00 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:22:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-75932884-7696-447e-9ad8-87abefe8c736 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 200 len: 1557 microversion: 2.1 time: 0.283608 Apr 12 16:22:00 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 333/998] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:22:00 2023] GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 1557 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ec19f-61e7-43af-92d7-44fbf8535d04", "name": "network-vif-unplugged", "status": "completed", "tag": "b392629c-5b31-400b-be14-aa168e45f717"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] Creating event network-vif-unplugged:b392629c-5b31-400b-be14-aa168e45f717 for instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 on user Apr 12 16:22:01 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-df40a2a0-44df-40ff-8f0a-103fdcbeaa0c req-33701265-998a-4270-aa0f-bd093d921552 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.213217 Apr 12 16:22:01 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 336/999] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:02 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ec19f-61e7-43af-92d7-44fbf8535d04", "name": "network-vif-deleted", "tag": "b392629c-5b31-400b-be14-aa168e45f717"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:02 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] Creating event network-vif-deleted:b392629c-5b31-400b-be14-aa168e45f717 for instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 on user Apr 12 16:22:02 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-d19509f8-fd30-4ce0-97d6-8f48978958aa req-af3530d6-91a0-4576-82cb-1b066c1a18f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032634 Apr 12 16:22:02 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 331/1000] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb6ec19f-61e7-43af-92d7-44fbf8535d04", "name": "network-vif-plugged", "status": "completed", "tag": "b392629c-5b31-400b-be14-aa168e45f717"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] Creating event network-vif-plugged:b392629c-5b31-400b-be14-aa168e45f717 for instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 on user Apr 12 16:22:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-f9ae1b0f-edff-4400-9923-4568073076cd req-943f5ff8-d113-4dde-9db2-8f7228a1def7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031176 Apr 12 16:22:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 334/1001] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=8 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2079897140", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "8a87df1a-24b8-499e-a908-0d1fa99ed69a"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] validate_networks() for [('8a87df1a-24b8-499e-a908-0d1fa99ed69a', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting quotas for project c91ef8cd37154632a031592cdc6792aa. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting quotas for user c9173175144449a391d282ba8978c9d9 and project c91ef8cd37154632a031592cdc6792aa. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:22:19 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:22:19 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-3ce9644a-3829-46ff-9cd6-3d4ccebb994a tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.526435 Apr 12 16:22:19 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 337/1002] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:22:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 528 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:22:19 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:19 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:19 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-0a724b26-b1df-400c-b067-5dabf48ccb50 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:19 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-0a724b26-b1df-400c-b067-5dabf48ccb50 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:19 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-0a724b26-b1df-400c-b067-5dabf48ccb50 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:22:19 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-0a724b26-b1df-400c-b067-5dabf48ccb50 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08" status: 200 len: 1213 microversion: 2.1 time: 0.098757 Apr 12 16:22:19 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 332/1003] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:22:19 2023] GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=8 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:20 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:22:20 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c582f687-7510-4cc7-a71c-9e38db5b93d1 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 204 len: 0 microversion: 2.1 time: 0.131980 Apr 12 16:22:20 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 335/1004] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:22:20 2023] DELETE /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:20 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:22:20 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-59ba4a4a-f784-4d84-a5f2-b635d049e842 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 200 len: 1553 microversion: 2.1 time: 0.157761 Apr 12 16:22:20 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 338/1005] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:22:20 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 1553 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:20 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-unplugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:20 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] Creating event network-vif-unplugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:22:20 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-80ddc14c-ef8f-4cec-ac8b-873b84b193fa req-d7bc2e88-1d1a-45ca-a486-652a66e64839 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028645 Apr 12 16:22:20 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 333/1006] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-plugged", "status": "completed", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] Creating event network-vif-plugged:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:22:22 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-ab747159-8b90-49cf-a4cf-99b2c2036546 req-6f012168-897a-4c9b-af85-f40b5e741efa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041198 Apr 12 16:22:22 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 336/1007] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:23 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ef81d71-afb0-4335-b60f-13071b957d08", "tag": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] Creating event network-changed:cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance 0ef81d71-afb0-4335-b60f-13071b957d08 on user Apr 12 16:22:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-4b95ea1a-fb78-4607-aed4-f7c596b03f9f req-09ef93cd-fb03-4452-b992-fae9cdebe12b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028374 Apr 12 16:22:23 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 339/1008] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-49a388ab-9cc9-469f-85e5-7161578cdf83 req-4d0d7d82-d16d-429e-a4e6-9f591222418f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bef10c89-360e-42d6-aa26-7edf1afca567", "name": "network-vif-deleted", "tag": "ecba9b76-45d2-49e7-addc-367dc21b38ce"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-49a388ab-9cc9-469f-85e5-7161578cdf83 req-4d0d7d82-d16d-429e-a4e6-9f591222418f service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-49a388ab-9cc9-469f-85e5-7161578cdf83 req-4d0d7d82-d16d-429e-a4e6-9f591222418f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-49a388ab-9cc9-469f-85e5-7161578cdf83 req-4d0d7d82-d16d-429e-a4e6-9f591222418f service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-49a388ab-9cc9-469f-85e5-7161578cdf83 req-4d0d7d82-d16d-429e-a4e6-9f591222418f service nova] Creating event network-vif-deleted:ecba9b76-45d2-49e7-addc-367dc21b38ce for instance bef10c89-360e-42d6-aa26-7edf1afca567 on user Apr 12 16:22:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-49a388ab-9cc9-469f-85e5-7161578cdf83 req-4d0d7d82-d16d-429e-a4e6-9f591222418f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034376 Apr 12 16:22:24 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 334/1009] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:25 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef81d71-afb0-4335-b60f-13071b957d08", "name": "network-vif-plugged", "status": "completed", "tag": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:25 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] Creating event network-vif-plugged:cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance 0ef81d71-afb0-4335-b60f-13071b957d08 on user Apr 12 16:22:25 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-bc804b0c-0462-4f24-b81e-c03825a13477 req-c436d08b-c4bd-44d5-be7b-2c1b6ed0757c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031552 Apr 12 16:22:25 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 337/1010] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef81d71-afb0-4335-b60f-13071b957d08", "name": "network-vif-plugged", "status": "completed", "tag": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] Creating event network-vif-plugged:cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance 0ef81d71-afb0-4335-b60f-13071b957d08 on user Apr 12 16:22:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-46595fb3-ed13-45d4-822a-919b3f1b02a1 req-0c3f8b92-2ba1-40b6-a02e-1bdeb38a4518 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035396 Apr 12 16:22:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 340/1011] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=8 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:40 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:40 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c1939108-3a1e-4535-8b2f-a238c57ea8b8 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101439 Apr 12 16:22:40 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 335/1012] 10.0.0.210 () {62 vars in 1352 bytes} [Wed Apr 12 16:22:40 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:41 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:41 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:41 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] Creating event network-changed:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:22:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-3f8c3fd8-1051-4058-a815-d871e15bb215 req-d59bacb4-0788-4232-b8b2-cd3b459bd25a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039724 Apr 12 16:22:41 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 338/1013] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=12 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:41 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:41 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2c673639-70bb-44d0-8754-51e41b6c6565 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/ips" status: 200 len: 103 microversion: 2.1 time: 0.046508 Apr 12 16:22:41 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 341/1014] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:22:41 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/ips => generated 103 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9ced9f7-ea73-42ee-a889-09d6ae729361"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d8c22a4d-884c-4d5f-908f-8aff1a721bd1 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279286 Apr 12 16:22:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 336/1015] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:22:43 2023] POST /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:49 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:49 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:49 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:50 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:50 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-8f981d5c-8b75-44b8-a143-40a6df1d097e tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058754 Apr 12 16:22:50 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 339/1016] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:22:49 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:50 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:50 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-aa9f4f6a-73fe-499b-8449-8d90a2a0a56d tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/b9ced9f7-ea73-42ee-a889-09d6ae729361" status: 200 len: 194 microversion: 2.1 time: 0.045179 Apr 12 16:22:50 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 342/1017] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 16:22:50 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/b9ced9f7-ea73-42ee-a889-09d6ae729361 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:50 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:22:50 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 HTTP/1.1 Apr 12 16:22:50 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:22:50 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:22:50 user devstack@n-api.service[61659]: Connection: close Apr 12 16:22:50 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:22:50 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:22:50 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:22:50 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:22:50 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:22:50 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:22:50 user devstack@n-api.service[61659]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:22:50 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:22:50 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:22:50 user devstack@n-api.service[61659]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:22:50 user devstack@n-api.service[61659]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:22:50 user devstack@n-api.service[61659]: method: > Apr 12 16:22:50 user devstack@n-api.service[61659]: exception: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:22:50 user devstack@n-api.service[61659]: action_args: {'id': 'eb6ec19f-61e7-43af-92d7-44fbf8535d04'} Apr 12 16:22:50 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:22:50 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:22:50 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:22:50 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5445de12-4c50-4672-a9a4-20d5e47191e7 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 404 len: 111 microversion: 2.1 time: 0.031284 Apr 12 16:22:50 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 337/1018] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:22:50 2023] GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "276e3d8f-d485-4148-9e7d-bb31e9d903f7"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:51 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:51 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e4bfd698-c771-4105-8efd-0ea875077f77 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303345 Apr 12 16:22:51 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 340/1019] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:22:51 2023] POST /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:53 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:22:53 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7de2639f-2b9b-46f9-a3d8-a059e6db6dbb tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 204 len: 0 microversion: 2.1 time: 0.148527 Apr 12 16:22:53 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 343/1020] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:22:53 2023] DELETE /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:53 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:22:53 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-44484f97-299f-4b6b-a609-fad186cf0673 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 200 len: 1399 microversion: 2.1 time: 0.286119 Apr 12 16:22:53 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 338/1021] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:22:53 2023] GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 1399 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:22:53 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77842113-37e8-4dc3-bd28-84417eb1ac31", "name": "network-vif-unplugged", "status": "completed", "tag": "c9b27dd5-a751-4179-af86-77931b5f55e6"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:53 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] Creating event network-vif-unplugged:c9b27dd5-a751-4179-af86-77931b5f55e6 for instance 77842113-37e8-4dc3-bd28-84417eb1ac31 on user Apr 12 16:22:53 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-95341ded-c519-4cb9-859f-76d997a2b7b7 req-65388f8e-311b-4eff-8391-63373dd4b05a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036871 Apr 12 16:22:53 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 341/1022] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:55 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d2c2fc9c-4b05-4a1a-8224-ccfa367e4733 req-44d1029f-d081-405d-b742-832935440e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77842113-37e8-4dc3-bd28-84417eb1ac31", "name": "network-vif-deleted", "tag": "c9b27dd5-a751-4179-af86-77931b5f55e6"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d2c2fc9c-4b05-4a1a-8224-ccfa367e4733 req-44d1029f-d081-405d-b742-832935440e88 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d2c2fc9c-4b05-4a1a-8224-ccfa367e4733 req-44d1029f-d081-405d-b742-832935440e88 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:55 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d2c2fc9c-4b05-4a1a-8224-ccfa367e4733 req-44d1029f-d081-405d-b742-832935440e88 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d2c2fc9c-4b05-4a1a-8224-ccfa367e4733 req-44d1029f-d081-405d-b742-832935440e88 service nova] Creating event network-vif-deleted:c9b27dd5-a751-4179-af86-77931b5f55e6 for instance 77842113-37e8-4dc3-bd28-84417eb1ac31 on user Apr 12 16:22:55 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d2c2fc9c-4b05-4a1a-8224-ccfa367e4733 req-44d1029f-d081-405d-b742-832935440e88 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032176 Apr 12 16:22:55 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 344/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77842113-37e8-4dc3-bd28-84417eb1ac31", "name": "network-vif-plugged", "status": "completed", "tag": "c9b27dd5-a751-4179-af86-77931b5f55e6"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:22:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] Creating event network-vif-plugged:c9b27dd5-a751-4179-af86-77931b5f55e6 for instance 77842113-37e8-4dc3-bd28-84417eb1ac31 on user Apr 12 16:22:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-d20146d4-7afd-4cf1-9316-9e77af1a1131 req-7975d195-2901-499f-90f9-09ac95a95807 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043012 Apr 12 16:22:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 339/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:22:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:59 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:59 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-11a9c054-797b-4b2c-9b6e-80939e1cdf0f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047041 Apr 12 16:22:59 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 342/1025] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:22:59 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:59 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:59 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-fb93347c-f42a-4d66-93ca-601221e44f90 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/b9ced9f7-ea73-42ee-a889-09d6ae729361" status: 200 len: 194 microversion: 2.1 time: 0.042034 Apr 12 16:22:59 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 345/1026] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 16:22:59 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/b9ced9f7-ea73-42ee-a889-09d6ae729361 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:22:59 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'services' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:22:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-69e0b2ba-030f-4c59-b0dd-9d7f11f21245 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/b9ced9f7-ea73-42ee-a889-09d6ae729361" status: 202 len: 0 microversion: 2.1 time: 0.154650 Apr 12 16:22:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 340/1027] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:22:59 2023] DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/b9ced9f7-ea73-42ee-a889-09d6ae729361 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:01 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:01 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-170c2176-d8d1-469c-9d3a-a1856584cb20 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/276e3d8f-d485-4148-9e7d-bb31e9d903f7" status: 200 len: 194 microversion: 2.1 time: 0.039827 Apr 12 16:23:01 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 343/1028] 10.0.0.210 () {62 vars in 1490 bytes} [Wed Apr 12 16:23:01 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/276e3d8f-d485-4148-9e7d-bb31e9d903f7 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:01 user devstack@n-api.service[61658]: DEBUG nova.objects.instance [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lazy-loading 'services' on Instance uuid 8503d42f-646c-4e59-91fd-0c006b08de7b {{(pid=61658) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:23:02 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4e8d47e1-8df9-4d3e-99f7-166a038421b5 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/276e3d8f-d485-4148-9e7d-bb31e9d903f7" status: 202 len: 0 microversion: 2.1 time: 0.238932 Apr 12 16:23:02 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 346/1029] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:23:01 2023] DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments/276e3d8f-d485-4148-9e7d-bb31e9d903f7 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1fb208bf-766d-46ca-a70c-352967d7280b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056453 Apr 12 16:23:04 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 341/1030] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:23:04 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1b1e8d65-bf19-47cf-9ecb-2820314bbfce tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043762 Apr 12 16:23:04 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 344/1031] 10.0.0.210 () {62 vars in 1379 bytes} [Wed Apr 12 16:23:04 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:23:04 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-333c8bc2-790f-4f03-b7c6-3b4c216f7c29 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b" status: 204 len: 0 microversion: 2.1 time: 0.147493 Apr 12 16:23:04 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 347/1032] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:23:04 2023] DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:04 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2996f6997bb14fc3aec9c3736cc65b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cf4334df004490ba51b4d92ce5408ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:23:04 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-de0d2f23-d84d-47e8-ba5c-69b88481dd9f tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b" status: 200 len: 1659 microversion: 2.1 time: 0.195649 Apr 12 16:23:04 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 342/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:04 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b => generated 1659 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-unplugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] Creating event network-vif-unplugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:23:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-425a0d5f-1f0b-40f0-b8fe-7a30284648a1 req-4a06ea3d-a9c1-4409-85c6-3534395ffafa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035098 Apr 12 16:23:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 345/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:07 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-plugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}, {"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-plugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}, {"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-plugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}, {"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-unplugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}, {"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-plugged", "status": "completed", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}, {"server_uuid": "8503d42f-646c-4e59-91fd-0c006b08de7b", "name": "network-vif-deleted", "tag": "48d1ca2a-7881-4f05-a889-0e40e46c0e12"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:07 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Creating event network-vif-plugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:23:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Creating event network-vif-plugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:23:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Creating event network-vif-plugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:23:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Creating event network-vif-unplugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:23:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Creating event network-vif-plugged:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:23:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] Creating event network-vif-deleted:48d1ca2a-7881-4f05-a889-0e40e46c0e12 for instance 8503d42f-646c-4e59-91fd-0c006b08de7b on user Apr 12 16:23:07 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-7347a9d6-3be8-4da6-aa10-34644e4b396f req-37feee9b-8b8a-4c6d-8d4e-81bf40801eee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.042505 Apr 12 16:23:07 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 348/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:07 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:09 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:23:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8aac03a4-a1ef-402d-9b49-3e34f6d9455e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08" status: 200 len: 1495 microversion: 2.1 time: 0.156153 Apr 12 16:23:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 343/1036] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:09 2023] GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08 => generated 1495 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:23:10 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 HTTP/1.1 Apr 12 16:23:10 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:23:10 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:23:10 user devstack@n-api.service[61657]: Connection: close Apr 12 16:23:10 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:23:10 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:23:10 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:23:10 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:23:10 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:23:10 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61657]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:23:10 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:23:10 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:23:10 user devstack@n-api.service[61657]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:23:10 user devstack@n-api.service[61657]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:23:10 user devstack@n-api.service[61657]: method: > Apr 12 16:23:10 user devstack@n-api.service[61657]: exception: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61657]: action_args: {'id': 'bef10c89-360e-42d6-aa26-7edf1afca567'} Apr 12 16:23:10 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:10 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-70e0a6e7-0458-408d-b1b0-8a2b42512037 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 404 len: 111 microversion: 2.1 time: 0.032513 Apr 12 16:23:10 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 346/1037] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:10 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:23:10 user devstack@n-api.service[61658]: request: DELETE /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 HTTP/1.1 Apr 12 16:23:10 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:23:10 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:23:10 user devstack@n-api.service[61658]: Connection: close Apr 12 16:23:10 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:23:10 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:23:10 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:23:10 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:23:10 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:23:10 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61658]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:23:10 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:23:10 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:23:10 user devstack@n-api.service[61658]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:23:10 user devstack@n-api.service[61658]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:23:10 user devstack@n-api.service[61658]: method: > Apr 12 16:23:10 user devstack@n-api.service[61658]: exception: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61658]: action_args: {'id': 'bef10c89-360e-42d6-aa26-7edf1afca567'} Apr 12 16:23:10 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1ae4aa87-ac25-43bb-8074-9fba282232af tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 404 len: 111 microversion: 2.1 time: 0.030840 Apr 12 16:23:10 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 349/1038] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:23:10 2023] DELETE /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: bef10c89-360e-42d6-aa26-7edf1afca567] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:23:10 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 HTTP/1.1 Apr 12 16:23:10 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:23:10 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:23:10 user devstack@n-api.service[61659]: Connection: close Apr 12 16:23:10 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:23:10 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:23:10 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:23:10 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:23:10 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:23:10 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:23:10 user devstack@n-api.service[61659]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:23:10 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:23:10 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:23:10 user devstack@n-api.service[61659]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:23:10 user devstack@n-api.service[61659]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:23:10 user devstack@n-api.service[61659]: method: > Apr 12 16:23:10 user devstack@n-api.service[61659]: exception: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61659]: action_args: {'id': 'bef10c89-360e-42d6-aa26-7edf1afca567'} Apr 12 16:23:10 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. Apr 12 16:23:10 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance bef10c89-360e-42d6-aa26-7edf1afca567 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-f8348fc9-cf4c-4a8c-929b-852abe717ab0 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567" status: 404 len: 111 microversion: 2.1 time: 0.029379 Apr 12 16:23:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 344/1039] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:10 2023] GET /compute/v2.1/servers/bef10c89-360e-42d6-aa26-7edf1afca567 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Going to try to terminate instance {{(pid=61657) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:23:10 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-c5a98f47-3ad0-4a49-bf01-05be842b562d tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976" status: 204 len: 0 microversion: 2.1 time: 0.125147 Apr 12 16:23:10 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 347/1040] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:23:10 2023] DELETE /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "name": "network-vif-unplugged", "status": "completed", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=21 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:10 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a699b3ba8304eadb8a53d465ea340cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97ea81bd1962466bbe552424973f71a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:10 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-4a83d448-cc70-4c49-bdf5-71b2408dda05 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976" status: 200 len: 1545 microversion: 2.1 time: 0.216370 Apr 12 16:23:10 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 350/1041] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:10 2023] GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976 => generated 1545 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] Creating event network-vif-unplugged:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:23:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-4d32e5a5-6d26-4d70-a125-57942cbb13c2 req-54903182-c73b-4447-9dc1-46b6eda47ef3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035793 Apr 12 16:23:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 345/1042] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:12 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-5f47bad3-fbeb-43d2-975c-b20be731c668 req-21a3e675-efd1-4923-80d4-183c1530df47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "name": "network-vif-deleted", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:12 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5f47bad3-fbeb-43d2-975c-b20be731c668 req-21a3e675-efd1-4923-80d4-183c1530df47 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5f47bad3-fbeb-43d2-975c-b20be731c668 req-21a3e675-efd1-4923-80d4-183c1530df47 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:12 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-5f47bad3-fbeb-43d2-975c-b20be731c668 req-21a3e675-efd1-4923-80d4-183c1530df47 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:12 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-5f47bad3-fbeb-43d2-975c-b20be731c668 req-21a3e675-efd1-4923-80d4-183c1530df47 service nova] Creating event network-vif-deleted:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:23:12 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-5f47bad3-fbeb-43d2-975c-b20be731c668 req-21a3e675-efd1-4923-80d4-183c1530df47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037585 Apr 12 16:23:12 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 348/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:12 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32471bee-e77e-4a1b-8e00-d938a1373976", "name": "network-vif-plugged", "status": "completed", "tag": "69029e57-b138-43c1-b31f-59bc7957994d"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:12 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:12 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] Creating event network-vif-plugged:69029e57-b138-43c1-b31f-59bc7957994d for instance 32471bee-e77e-4a1b-8e00-d938a1373976 on user Apr 12 16:23:12 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-6b9902ea-8ab9-49e4-a310-db0ecc38cb1b req-ab44a389-63f0-4eef-a23b-77b57ab9e0f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036920 Apr 12 16:23:12 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 351/1044] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:23:43 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 HTTP/1.1 Apr 12 16:23:43 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:23:43 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:23:43 user devstack@n-api.service[61659]: Connection: close Apr 12 16:23:43 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:23:43 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:23:43 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:23:43 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:23:43 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:43 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61659]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:43 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:23:43 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:23:43 user devstack@n-api.service[61659]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:23:43 user devstack@n-api.service[61659]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:43 user devstack@n-api.service[61659]: method: > Apr 12 16:23:43 user devstack@n-api.service[61659]: exception: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61659]: action_args: {'id': '77842113-37e8-4dc3-bd28-84417eb1ac31'} Apr 12 16:23:43 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-e31a2dba-9320-48f7-99e4-9d88b830150f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 404 len: 111 microversion: 2.1 time: 0.035188 Apr 12 16:23:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 346/1045] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:43 2023] GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:43 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:23:43 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 HTTP/1.1 Apr 12 16:23:43 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:23:43 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:23:43 user devstack@n-api.service[61657]: Connection: close Apr 12 16:23:43 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:23:43 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:23:43 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:23:43 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:23:43 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:43 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61657]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:43 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:23:43 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:23:43 user devstack@n-api.service[61657]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:23:43 user devstack@n-api.service[61657]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:43 user devstack@n-api.service[61657]: method: > Apr 12 16:23:43 user devstack@n-api.service[61657]: exception: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61657]: action_args: {'id': 'eb6ec19f-61e7-43af-92d7-44fbf8535d04'} Apr 12 16:23:43 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:43 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-83544e83-52e2-4918-94da-c42f0b982a96 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 404 len: 111 microversion: 2.1 time: 0.032030 Apr 12 16:23:43 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 349/1046] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:23:43 2023] DELETE /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: eb6ec19f-61e7-43af-92d7-44fbf8535d04] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:23:43 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 HTTP/1.1 Apr 12 16:23:43 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:23:43 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:23:43 user devstack@n-api.service[61658]: Connection: close Apr 12 16:23:43 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:23:43 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:23:43 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:23:43 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:23:43 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:43 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:43 user devstack@n-api.service[61658]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:43 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:23:43 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:23:43 user devstack@n-api.service[61658]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:23:43 user devstack@n-api.service[61658]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:43 user devstack@n-api.service[61658]: method: > Apr 12 16:23:43 user devstack@n-api.service[61658]: exception: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61658]: action_args: {'id': 'eb6ec19f-61e7-43af-92d7-44fbf8535d04'} Apr 12 16:23:43 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. Apr 12 16:23:43 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:23:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance eb6ec19f-61e7-43af-92d7-44fbf8535d04 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-286a1ba3-c00e-4510-9376-c24b457b7575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04" status: 404 len: 111 microversion: 2.1 time: 0.034621 Apr 12 16:23:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 352/1047] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:43 2023] GET /compute/v2.1/servers/eb6ec19f-61e7-43af-92d7-44fbf8535d04 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:23:44 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 HTTP/1.1 Apr 12 16:23:44 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:23:44 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:23:44 user devstack@n-api.service[61659]: Connection: close Apr 12 16:23:44 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:23:44 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:23:44 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:23:44 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:23:44 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:44 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:44 user devstack@n-api.service[61659]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:44 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:23:44 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:23:44 user devstack@n-api.service[61659]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:23:44 user devstack@n-api.service[61659]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:44 user devstack@n-api.service[61659]: method: > Apr 12 16:23:44 user devstack@n-api.service[61659]: exception: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61659]: action_args: {'id': '77842113-37e8-4dc3-bd28-84417eb1ac31'} Apr 12 16:23:44 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:44 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c071c4c2-41b8-4094-a4cd-f598b6d2003c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 404 len: 111 microversion: 2.1 time: 0.026774 Apr 12 16:23:44 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 347/1048] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:23:43 2023] DELETE /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 77842113-37e8-4dc3-bd28-84417eb1ac31] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:23:44 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 HTTP/1.1 Apr 12 16:23:44 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:23:44 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:23:44 user devstack@n-api.service[61657]: Connection: close Apr 12 16:23:44 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:23:44 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:23:44 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:23:44 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:23:44 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:23:44 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:23:44 user devstack@n-api.service[61657]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:44 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:23:44 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:23:44 user devstack@n-api.service[61657]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:23:44 user devstack@n-api.service[61657]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:23:44 user devstack@n-api.service[61657]: method: > Apr 12 16:23:44 user devstack@n-api.service[61657]: exception: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61657]: action_args: {'id': '77842113-37e8-4dc3-bd28-84417eb1ac31'} Apr 12 16:23:44 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. Apr 12 16:23:44 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:23:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance 77842113-37e8-4dc3-bd28-84417eb1ac31 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-118229a4-6854-41de-9d64-74c41e616894 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31" status: 404 len: 111 microversion: 2.1 time: 0.029241 Apr 12 16:23:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 350/1049] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:44 2023] GET /compute/v2.1/servers/77842113-37e8-4dc3-bd28-84417eb1ac31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:44 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-cb791a97-161b-423d-bf77-9955d9ca29db tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'create', calling method: .version_select at 0x7fdee7613d90>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2081417066", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGG/oSOmCDB20hkof5ViTlXYepxJsQ10bBtdYs7WKmIje03wdrGPlfe9DBPbPhAeMjSuszZPOH/w828DcGTtmLpZpE/aguNTugqw/I5GMmvTcJqr8fOGXLe6lzwKxF1ecQ=="}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:44 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-cb791a97-161b-423d-bf77-9955d9ca29db tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:23:44 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-cb791a97-161b-423d-bf77-9955d9ca29db tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for user 7054687447fc42339e9046ced4915890 and project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'key_pairs'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:23:44 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-cb791a97-161b-423d-bf77-9955d9ca29db tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049038 Apr 12 16:23:44 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 353/1050] 10.0.0.210 () {64 vars in 1236 bytes} [Wed Apr 12 16:23:44 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-515149958", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-2081417066", "security_groups": [{"name": "tempest-secgroup-smoke-1275514734"}], "block_device_mapping_v2": [{"uuid": "7ae18173-eee9-4607-b0a7-940d48146909", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1439244b-8287-4bba-a88c-99d4b498cccd"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] validate_networks() for [('1439244b-8287-4bba-a88c-99d4b498cccd', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for user 7054687447fc42339e9046ced4915890 and project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:23:48 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ae18173-eee9-4607-b0a7-940d48146909',volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:23:48 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-020d960b-f749-461c-bf09-7ec71b67b6de tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.904202 Apr 12 16:23:48 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 348/1051] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:23:48 2023] POST /compute/v2.1/servers => generated 404 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:23:48 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-28a7c50f-3102-4c7a-8c2a-cedc86179dba tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:48 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-28a7c50f-3102-4c7a-8c2a-cedc86179dba tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:49 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-28a7c50f-3102-4c7a-8c2a-cedc86179dba tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:23:49 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-28a7c50f-3102-4c7a-8c2a-cedc86179dba tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 200 len: 1089 microversion: 2.1 time: 0.063837 Apr 12 16:23:49 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 351/1052] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:48 2023] GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 1089 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:23:51 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9a374be-4852-45e3-b346-79a08b60f981", "tag": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:51 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] Creating event network-changed:aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance d9a374be-4852-45e3-b346-79a08b60f981 on user Apr 12 16:23:51 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-3dc00224-09ac-4893-9b24-23a2c0c14c62 req-7642d90b-c5cb-49c5-9346-4893d5ef17ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030588 Apr 12 16:23:51 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 354/1053] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HTTP exception thrown: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Request method failure captured: Apr 12 16:23:55 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b HTTP/1.1 Apr 12 16:23:55 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:23:55 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:23:55 user devstack@n-api.service[61659]: Connection: close Apr 12 16:23:55 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:23:55 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:23:55 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:23:55 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:23:55 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtfyRm3HaVmM3PkhKndzmXYHQY_-2jlWf0xpf2TMiUB5pJVUa1PqOynC5D6b1KrencTuNR7cl8Dr4C82YH8-MXsF8bVg5gjgnAB0BpNc2-kXQR2mX7onFNEYAsy_U9zz_-g_xvFpqNEpdEouwLCcQmwQ2veiJvWKNm1shOLfB0rm8eo Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Project-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Project-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Tenant: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Tenant-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:23:55 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:23:55 user devstack@n-api.service[61659]: X-User: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:23:55 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:23:55 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:23:55 user devstack@n-api.service[61659]: X-User-Id: 2996f6997bb14fc3aec9c3736cc65b8a Apr 12 16:23:55 user devstack@n-api.service[61659]: X-User-Name: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:23:55 user devstack@n-api.service[61659]: method: > Apr 12 16:23:55 user devstack@n-api.service[61659]: exception: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:23:55 user devstack@n-api.service[61659]: action_args: {'id': '8503d42f-646c-4e59-91fd-0c006b08de7b'} Apr 12 16:23:55 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:23:55 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:23:55 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Returning 404 to user: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:23:55 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-22197a6d-a071-44d1-9e85-dda0018b99bc tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b" status: 404 len: 111 microversion: 2.1 time: 0.029979 Apr 12 16:23:55 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 349/1054] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:23:54 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:23:55 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-0790121f-4f03-487f-bc7c-b3a635be55c9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '.version_select at 0x7fdee78bbb50>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:23:55 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=5 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:55 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-0790121f-4f03-487f-bc7c-b3a635be55c9 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-857316521" status: 202 len: 0 microversion: 2.1 time: 0.024082 Apr 12 16:23:55 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 352/1055] 10.0.0.210 () {62 vars in 1295 bytes} [Wed Apr 12 16:23:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-857316521 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:23:57 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:57 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a374be-4852-45e3-b346-79a08b60f981", "name": "network-vif-plugged", "status": "completed", "tag": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:57 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:57 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] Creating event network-vif-plugged:aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance d9a374be-4852-45e3-b346-79a08b60f981 on user Apr 12 16:23:57 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-89ef34e7-06d0-470b-a606-74419d786303 req-29f91d02-46e9-4bab-b1e0-c96e83d000fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041863 Apr 12 16:23:57 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 355/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:23:59 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a374be-4852-45e3-b346-79a08b60f981", "name": "network-vif-plugged", "status": "completed", "tag": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:23:59 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:59 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:23:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:23:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:23:59 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:23:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] Creating event network-vif-plugged:aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance d9a374be-4852-45e3-b346-79a08b60f981 on user Apr 12 16:23:59 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-bc20e533-47d9-4e0a-bff3-de28178f0389 req-d1c4ecb8-6fdc-422a-a92d-fd33d0e90268 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039704 Apr 12 16:23:59 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 350/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:23:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HTTP exception thrown: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Request method failure captured: Apr 12 16:24:00 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b HTTP/1.1 Apr 12 16:24:00 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:24:00 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:24:00 user devstack@n-api.service[61657]: Connection: close Apr 12 16:24:00 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:24:00 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:24:00 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:24:00 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:24:00 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtfyRm3HaVmM3PkhKndzmXYHQY_-2jlWf0xpf2TMiUB5pJVUa1PqOynC5D6b1KrencTuNR7cl8Dr4C82YH8-MXsF8bVg5gjgnAB0BpNc2-kXQR2mX7onFNEYAsy_U9zz_-g_xvFpqNEpdEouwLCcQmwQ2veiJvWKNm1shOLfB0rm8eo Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Project-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Tenant-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:00 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:00 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:00 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:24:00 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:24:00 user devstack@n-api.service[61657]: X-User-Id: 2996f6997bb14fc3aec9c3736cc65b8a Apr 12 16:24:00 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:00 user devstack@n-api.service[61657]: method: > Apr 12 16:24:00 user devstack@n-api.service[61657]: exception: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61657]: action_args: {'id': '8503d42f-646c-4e59-91fd-0c006b08de7b'} Apr 12 16:24:00 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Returning 404 to user: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:00 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9fa2ddd6-bebd-4fbc-a528-a366e77e1c46 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b" status: 404 len: 111 microversion: 2.1 time: 0.058171 Apr 12 16:24:00 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 353/1058] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:24:00 2023] DELETE /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 8503d42f-646c-4e59-91fd-0c006b08de7b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HTTP exception thrown: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Request method failure captured: Apr 12 16:24:00 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b HTTP/1.1 Apr 12 16:24:00 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:24:00 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:24:00 user devstack@n-api.service[61658]: Connection: close Apr 12 16:24:00 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:24:00 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:24:00 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:24:00 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:24:00 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtfyRm3HaVmM3PkhKndzmXYHQY_-2jlWf0xpf2TMiUB5pJVUa1PqOynC5D6b1KrencTuNR7cl8Dr4C82YH8-MXsF8bVg5gjgnAB0BpNc2-kXQR2mX7onFNEYAsy_U9zz_-g_xvFpqNEpdEouwLCcQmwQ2veiJvWKNm1shOLfB0rm8eo Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Project-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Tenant-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:00 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:00 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:00 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:24:00 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:24:00 user devstack@n-api.service[61658]: X-User-Id: 2996f6997bb14fc3aec9c3736cc65b8a Apr 12 16:24:00 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:00 user devstack@n-api.service[61658]: method: > Apr 12 16:24:00 user devstack@n-api.service[61658]: exception: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61658]: action_args: {'id': '8503d42f-646c-4e59-91fd-0c006b08de7b'} Apr 12 16:24:00 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. Apr 12 16:24:00 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Returning 404 to user: Instance 8503d42f-646c-4e59-91fd-0c006b08de7b could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:00 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-552f7391-3606-4f51-9697-6982c70de16b tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b" status: 404 len: 111 microversion: 2.1 time: 0.038176 Apr 12 16:24:00 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 356/1059] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:24:00 2023] GET /compute/v2.1/servers/8503d42f-646c-4e59-91fd-0c006b08de7b => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: 32471bee-e77e-4a1b-8e00-d938a1373976] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance 32471bee-e77e-4a1b-8e00-d938a1373976 could not be found. Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:24:00 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976 HTTP/1.1 Apr 12 16:24:00 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:24:00 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:24:00 user devstack@n-api.service[61659]: Connection: close Apr 12 16:24:00 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:24:00 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:24:00 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:24:00 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:24:00 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:24:00 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:00 user devstack@n-api.service[61659]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:24:00 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:24:00 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:24:00 user devstack@n-api.service[61659]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:24:00 user devstack@n-api.service[61659]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:24:00 user devstack@n-api.service[61659]: method: > Apr 12 16:24:00 user devstack@n-api.service[61659]: exception: Instance 32471bee-e77e-4a1b-8e00-d938a1373976 could not be found. Apr 12 16:24:00 user devstack@n-api.service[61659]: action_args: {'id': '32471bee-e77e-4a1b-8e00-d938a1373976'} Apr 12 16:24:00 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32471bee-e77e-4a1b-8e00-d938a1373976 could not be found. Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32471bee-e77e-4a1b-8e00-d938a1373976 could not be found. Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32471bee-e77e-4a1b-8e00-d938a1373976 could not be found. Apr 12 16:24:00 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:00 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance 32471bee-e77e-4a1b-8e00-d938a1373976 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:00 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-1590ac02-51f6-4181-a3f7-bcf199e7dfd9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976" status: 404 len: 111 microversion: 2.1 time: 0.044557 Apr 12 16:24:00 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 351/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:24:00 2023] GET /compute/v2.1/servers/32471bee-e77e-4a1b-8e00-d938a1373976 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HTTP exception thrown: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Request method failure captured: Apr 12 16:24:03 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 HTTP/1.1 Apr 12 16:24:03 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:24:03 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:24:03 user devstack@n-api.service[61657]: Connection: close Apr 12 16:24:03 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:24:03 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:24:03 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:24:03 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:24:03 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtfyRm3HaVmM3PkhKndzmXYHQY_-2jlWf0xpf2TMiUB5pJVUa1PqOynC5D6b1KrencTuNR7cl8Dr4C82YH8-MXsF8bVg5gjgnAB0BpNc2-kXQR2mX7onFNEYAsy_U9zz_-g_xvFpqNEpdEouwLCcQmwQ2veiJvWKNm1shOLfB0rm8eo Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Project-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Project-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Tenant: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Tenant-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:03 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:03 user devstack@n-api.service[61657]: X-User: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:03 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:24:03 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:24:03 user devstack@n-api.service[61657]: X-User-Id: 2996f6997bb14fc3aec9c3736cc65b8a Apr 12 16:24:03 user devstack@n-api.service[61657]: X-User-Name: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:03 user devstack@n-api.service[61657]: method: > Apr 12 16:24:03 user devstack@n-api.service[61657]: exception: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61657]: action_args: {'id': '4190e244-84b1-47b6-813d-9cadb7c65975'} Apr 12 16:24:03 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Returning 404 to user: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:03 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-15896290-5797-4f4b-a87d-2a44acfb83a2 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 404 len: 111 microversion: 2.1 time: 0.089565 Apr 12 16:24:03 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 354/1061] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:24:03 2023] DELETE /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] [instance: 4190e244-84b1-47b6-813d-9cadb7c65975] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] HTTP exception thrown: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Request method failure captured: Apr 12 16:24:03 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 HTTP/1.1 Apr 12 16:24:03 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:24:03 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:24:03 user devstack@n-api.service[61658]: Connection: close Apr 12 16:24:03 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:24:03 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:24:03 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:24:03 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:24:03 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtfyRm3HaVmM3PkhKndzmXYHQY_-2jlWf0xpf2TMiUB5pJVUa1PqOynC5D6b1KrencTuNR7cl8Dr4C82YH8-MXsF8bVg5gjgnAB0BpNc2-kXQR2mX7onFNEYAsy_U9zz_-g_xvFpqNEpdEouwLCcQmwQ2veiJvWKNm1shOLfB0rm8eo Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Project-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Project-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7cf4334df004490ba51b4d92ce5408ae"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Tenant: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Tenant-Id: 7cf4334df004490ba51b4d92ce5408ae Apr 12 16:24:03 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-AttachVolumeTestJSON-178648074 Apr 12 16:24:03 user devstack@n-api.service[61658]: X-User: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:03 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:24:03 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:24:03 user devstack@n-api.service[61658]: X-User-Id: 2996f6997bb14fc3aec9c3736cc65b8a Apr 12 16:24:03 user devstack@n-api.service[61658]: X-User-Name: tempest-AttachVolumeTestJSON-178648074-project-member Apr 12 16:24:03 user devstack@n-api.service[61658]: method: > Apr 12 16:24:03 user devstack@n-api.service[61658]: exception: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61658]: action_args: {'id': '4190e244-84b1-47b6-813d-9cadb7c65975'} Apr 12 16:24:03 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. Apr 12 16:24:03 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:03 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] Returning 404 to user: Instance 4190e244-84b1-47b6-813d-9cadb7c65975 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:03 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-e63d56f7-b6bb-4e4c-bda2-319c80edfe36 tempest-AttachVolumeTestJSON-178648074 tempest-AttachVolumeTestJSON-178648074-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975" status: 404 len: 111 microversion: 2.1 time: 0.040059 Apr 12 16:24:03 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 357/1062] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:24:03 2023] GET /compute/v2.1/servers/4190e244-84b1-47b6-813d-9cadb7c65975 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:24:05 user devstack@n-api.service[61659]: request: DELETE /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 HTTP/1.1 Apr 12 16:24:05 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:24:05 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:24:05 user devstack@n-api.service[61659]: Connection: close Apr 12 16:24:05 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:24:05 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:24:05 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:24:05 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:24:05 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:24:05 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:05 user devstack@n-api.service[61659]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:24:05 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:24:05 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:24:05 user devstack@n-api.service[61659]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:24:05 user devstack@n-api.service[61659]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:24:05 user devstack@n-api.service[61659]: method: > Apr 12 16:24:05 user devstack@n-api.service[61659]: exception: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61659]: action_args: {'id': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'} Apr 12 16:24:05 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:05 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6f74d9d7-1fee-46f9-bf9d-8e5ad254daa9 tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 404 len: 111 microversion: 2.1 time: 0.041237 Apr 12 16:24:05 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 352/1063] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:24:05 2023] DELETE /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] [instance: dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] HTTP exception thrown: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Request method failure captured: Apr 12 16:24:05 user devstack@n-api.service[61657]: request: GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 HTTP/1.1 Apr 12 16:24:05 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:24:05 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:24:05 user devstack@n-api.service[61657]: Connection: close Apr 12 16:24:05 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:24:05 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:24:05 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:24:05 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:24:05 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtVawhWXBtr3H9s8xmHQH5e3en7U8hhdUYzG5MmdYMJ1fzob6M0efPAfwkszLdUtQ0bPdv9ihCjgduxImCEMTGbCcoBXSj3OgOjzZs7Xgp9P4vC83V6a4QuNz3EUDSfGWw_uV1Tm83TObHJ98aTW3F_4Ll30VOOeTp3-WcBY2kA01nk Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Project-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Project-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/97ea81bd1962466bbe552424973f71a8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Tenant: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Tenant-Id: 97ea81bd1962466bbe552424973f71a8 Apr 12 16:24:05 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-ServerActionsTestJSON-631887779 Apr 12 16:24:05 user devstack@n-api.service[61657]: X-User: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:24:05 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:24:05 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:24:05 user devstack@n-api.service[61657]: X-User-Id: 1a699b3ba8304eadb8a53d465ea340cf Apr 12 16:24:05 user devstack@n-api.service[61657]: X-User-Name: tempest-ServerActionsTestJSON-631887779-project-member Apr 12 16:24:05 user devstack@n-api.service[61657]: method: > Apr 12 16:24:05 user devstack@n-api.service[61657]: exception: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61657]: action_args: {'id': 'dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1'} Apr 12 16:24:05 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. Apr 12 16:24:05 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:05 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Returning 404 to user: Instance dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:05 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-88b207bd-13e1-4d09-b7c7-90b7527a485e tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1" status: 404 len: 111 microversion: 2.1 time: 0.099492 Apr 12 16:24:05 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 355/1064] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:24:05 2023] GET /compute/v2.1/servers/dcd1b6ae-16dc-4d15-95ed-ce80c3c4f1c1 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:05 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-8d7cdee4-0ba3-4bbf-878e-caaa1ff2407f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] Calling method '.version_select at 0x7fdee774b9a0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:05 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-8d7cdee4-0ba3-4bbf-878e-caaa1ff2407f tempest-ServerActionsTestJSON-631887779 tempest-ServerActionsTestJSON-631887779-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923467613" status: 202 len: 0 microversion: 2.1 time: 0.036248 Apr 12 16:24:05 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 358/1065] 10.0.0.210 () {62 vars in 1298 bytes} [Wed Apr 12 16:24:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1923467613 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "080c2e7c-0047-4794-90a2-ab4835def5de", "device": "/dev/vdb"}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:10 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:10 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-38e09fcc-50a3-4a14-9a74-08c0c648be84 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "POST /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277364 Apr 12 16:24:10 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 353/1066] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:24:10 2023] POST /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:10 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1251953966", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "28cbab83-7a0f-44eb-98c5-9d1c9fb305c3"}]}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:10 user devstack@n-api.service[61657]: DEBUG nova.network.neutron [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] validate_networks() for [('28cbab83-7a0f-44eb-98c5-9d1c9fb305c3', None, None, None, None, None)] {{(pid=61657) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Flavor limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Image limits 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Flavor pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Image pref 0:0:0 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.virt.hardware [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61657) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Getting quotas for project 5af762be84c243289780b7af16caae5c. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.quota [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Getting quotas for user 995a52402acf40bf88b6c7c0440b1b94 and project 5af762be84c243289780b7af16caae5c. Resources: {'ram', 'cores', 'instances'} {{(pid=61657) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Going to run 1 instances... {{(pid=61657) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:24:11 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61657) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:24:11 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3b37d2be-de53-4106-852a-c76b015ec88f tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.041492 Apr 12 16:24:11 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 356/1067] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:24:10 2023] POST /compute/v2.1/servers => generated 378 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:24:11 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5306d322-4ef6-4a19-a3df-dd7dc539890e tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:11 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5306d322-4ef6-4a19-a3df-dd7dc539890e tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:11 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-5306d322-4ef6-4a19-a3df-dd7dc539890e tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995a52402acf40bf88b6c7c0440b1b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af762be84c243289780b7af16caae5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:24:11 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5306d322-4ef6-4a19-a3df-dd7dc539890e tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4" status: 200 len: 1208 microversion: 2.1 time: 0.071307 Apr 12 16:24:11 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 359/1068] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:24:11 2023] GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => generated 1208 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:14 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b40e07a-eb45-4fe7-9f98-dc718231a4a4", "tag": "f4ad5837-50cf-4283-aee0-7f531fb6cee6"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:14 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:14 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:14 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] Creating event network-changed:f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 on user Apr 12 16:24:14 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-87423761-d569-4f50-b177-42cce6005c64 req-aa28d82e-eba9-4201-b796-5fa26909163b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042362 Apr 12 16:24:14 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 354/1069] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:24:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:15 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-0489d179-fb23-4ec5-9d6c-c3e5b9958237 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee77e49d0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:15 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-0489d179-fb23-4ec5-9d6c-c3e5b9958237 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5d9cf51f-d3ed-498d-a69e-28157996f323" status: 200 len: 350 microversion: 2.1 time: 0.054029 Apr 12 16:24:15 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 357/1070] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:24:15 2023] GET /compute/v2.1/os-volumes/5d9cf51f-d3ed-498d-a69e-28157996f323 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:16 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-b151ac25-2341-4a00-a375-abdf778587e3 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee79c64d0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:16 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=10 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:16 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-b151ac25-2341-4a00-a375-abdf778587e3 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/a1fac2eb-e8ed-41ef-b468-18273958d1b4" status: 200 len: 351 microversion: 2.1 time: 0.068166 Apr 12 16:24:16 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 360/1071] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:24:16 2023] GET /compute/v2.1/os-volumes/a1fac2eb-e8ed-41ef-b468-18273958d1b4 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b40e07a-eb45-4fe7-9f98-dc718231a4a4", "name": "network-vif-plugged", "status": "completed", "tag": "f4ad5837-50cf-4283-aee0-7f531fb6cee6"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:16 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] Creating event network-vif-plugged:f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 on user Apr 12 16:24:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-6596a203-515f-4c23-b090-bc3dd6ea5cc8 req-34b80104-a43c-4448-b214-84288c9cf3fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032916 Apr 12 16:24:16 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 355/1072] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:24:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:17 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7dfb289c-3c61-4a80-bbf9-b2939a1a8a77 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee76eb5b0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7dfb289c-3c61-4a80-bbf9-b2939a1a8a77 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/342f35e2-9c0e-4495-9705-632964b1ff7a" status: 200 len: 351 microversion: 2.1 time: 0.051461 Apr 12 16:24:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 358/1073] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:24:17 2023] GET /compute/v2.1/os-volumes/342f35e2-9c0e-4495-9705-632964b1ff7a => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-3db6dbcd-c813-4a14-b550-01243dc031ae tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee7748e50>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-3db6dbcd-c813-4a14-b550-01243dc031ae tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089594 Apr 12 16:24:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 361/1074] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-6cedf007-245b-47cb-80a4-9c4a0ea70e91 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee751dc60>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-6cedf007-245b-47cb-80a4-9c4a0ea70e91 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096768 Apr 12 16:24:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 356/1075] 10.0.0.210 () {62 vars in 1226 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7b4c2d8b-3008-4746-b64a-2fdb7c3cc2b2 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee77e49d0>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7b4c2d8b-3008-4746-b64a-2fdb7c3cc2b2 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.093533 Apr 12 16:24:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 359/1076] 10.0.0.210 () {62 vars in 1211 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-817512ae-288e-4438-96c7-d214aac292f4 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee7ad4c10>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-817512ae-288e-4438-96c7-d214aac292f4 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083722 Apr 12 16:24:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 362/1077] 10.0.0.210 () {62 vars in 1244 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-27a4aaa1-5f0a-4233-9368-3294a5cb544e tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee7c2c5e0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-27a4aaa1-5f0a-4233-9368-3294a5cb544e tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.096514 Apr 12 16:24:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 357/1078] 10.0.0.210 () {62 vars in 1247 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-9e30946a-8598-457d-8f29-5c93d8827a3b tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee76eaf80>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-9e30946a-8598-457d-8f29-5c93d8827a3b tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087606 Apr 12 16:24:18 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 360/1079] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f8ba9421-e54f-4585-8051-83cb727d68c8 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee7b7d120>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f8ba9421-e54f-4585-8051-83cb727d68c8 tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084508 Apr 12 16:24:18 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 363/1080] 10.0.0.210 () {62 vars in 1265 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-fb8306cd-aea4-47b8-8ec6-120c0b1107bc tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] Calling method '.version_select at 0x7fdee7cb5240>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-fb8306cd-aea4-47b8-8ec6-120c0b1107bc tempest-VolumesTestJSON-1690052769 tempest-VolumesTestJSON-1690052769-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091175 Apr 12 16:24:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 358/1081] 10.0.0.210 () {62 vars in 1232 bytes} [Wed Apr 12 16:24:18 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 12 16:24:18 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b40e07a-eb45-4fe7-9f98-dc718231a4a4", "name": "network-vif-plugged", "status": "completed", "tag": "f4ad5837-50cf-4283-aee0-7f531fb6cee6"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:18 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:19 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:19 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] Creating event network-vif-plugged:f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 on user Apr 12 16:24:19 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-4f11e5a5-6779-4bca-9d44-3b32e0718553 req-ca5a80b6-f719-4b41-b131-d76aa1b91592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040531 Apr 12 16:24:19 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 361/1082] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:24:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f92c965d-79e4-4489-a4b1-ba1a4285157a tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Action: 'create', calling method: .version_select at 0x7fdee774b910>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-19068715", "metadata": {"Type": "work"}}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f92c965d-79e4-4489-a4b1-ba1a4285157a tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Request method failure captured: Apr 12 16:24:29 user devstack@n-api.service[61658]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 16:24:29 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:24:29 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:24:29 user devstack@n-api.service[61658]: Connection: close Apr 12 16:24:29 user devstack@n-api.service[61658]: Content-Length: 120 Apr 12 16:24:29 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:24:29 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:24:29 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:24:29 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNts9_WRt7WUY2XdO_Uorq1VdSsS6pgw3YuQfQb7HygCKYTIuaEAvJy5M5ut53mLvfJaY44wIfGMeNSBHNYY68zomb0QF59dpYTR6hZGt1x_mFtlQFLkUOsakBjxeoElCcg8rRwGM3aO7A8kEUyIfQLfl8H9g1W9c0xccCveb6eyDhh4 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9583e85edd34e2593be56260112772e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Id: 4a050adae85d407c8855e5c762ff5615 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Name: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61658]: Apr 12 16:24:29 user devstack@n-api.service[61658]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-19068715", "metadata": {"Type": "work"}}} Apr 12 16:24:29 user devstack@n-api.service[61658]: method: Apr 12 16:24:29 user devstack@n-api.service[61658]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61658]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-19068715', 'metadata': {'Type': 'work'}}}} Apr 12 16:24:29 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise error Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi '#$%' Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f92c965d-79e4-4489-a4b1-ba1a4285157a tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f92c965d-79e4-4489-a4b1-ba1a4285157a tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.193315 Apr 12 16:24:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 364/1083] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 16:24:29 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 197 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=3 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8f0d33f4-856a-4b88-a84f-6d8ed55cce49 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Action: 'create', calling method: .version_select at 0x7fdee7729fc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2072724109", "metadata": {"Type": "work"}}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8f0d33f4-856a-4b88-a84f-6d8ed55cce49 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Request method failure captured: Apr 12 16:24:29 user devstack@n-api.service[61659]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 16:24:29 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:24:29 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:24:29 user devstack@n-api.service[61659]: Connection: close Apr 12 16:24:29 user devstack@n-api.service[61659]: Content-Length: 120 Apr 12 16:24:29 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:24:29 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:24:29 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:24:29 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNts9_WRt7WUY2XdO_Uorq1VdSsS6pgw3YuQfQb7HygCKYTIuaEAvJy5M5ut53mLvfJaY44wIfGMeNSBHNYY68zomb0QF59dpYTR6hZGt1x_mFtlQFLkUOsakBjxeoElCcg8rRwGM3aO7A8kEUyIfQLfl8H9g1W9c0xccCveb6eyDhh4 Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Project-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9583e85edd34e2593be56260112772e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Tenant-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61659]: X-User: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61659]: X-User-Id: 4a050adae85d407c8855e5c762ff5615 Apr 12 16:24:29 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61659]: Apr 12 16:24:29 user devstack@n-api.service[61659]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2072724109", "metadata": {"Type": "work"}}} Apr 12 16:24:29 user devstack@n-api.service[61659]: method: Apr 12 16:24:29 user devstack@n-api.service[61659]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 16:24:29 user devstack@n-api.service[61659]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2072724109', 'metadata': {'Type': 'work'}}}} Apr 12 16:24:29 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise error Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi '0' Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 12 16:24:29 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-8f0d33f4-856a-4b88-a84f-6d8ed55cce49 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-8f0d33f4-856a-4b88-a84f-6d8ed55cce49 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023043 Apr 12 16:24:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 359/1084] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 16:24:29 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=10 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:24:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e1a0e252-da90-46bb-9f5f-dc41ee323906 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Action: 'create', calling method: .version_select at 0x7fdee76e85e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1863623530", "metadata": {"Type": "work"}}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e1a0e252-da90-46bb-9f5f-dc41ee323906 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Request method failure captured: Apr 12 16:24:29 user devstack@n-api.service[61657]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 12 16:24:29 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:24:29 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:24:29 user devstack@n-api.service[61657]: Connection: close Apr 12 16:24:29 user devstack@n-api.service[61657]: Content-Length: 119 Apr 12 16:24:29 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:24:29 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:24:29 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:24:29 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNts9_WRt7WUY2XdO_Uorq1VdSsS6pgw3YuQfQb7HygCKYTIuaEAvJy5M5ut53mLvfJaY44wIfGMeNSBHNYY68zomb0QF59dpYTR6hZGt1x_mFtlQFLkUOsakBjxeoElCcg8rRwGM3aO7A8kEUyIfQLfl8H9g1W9c0xccCveb6eyDhh4 Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Project-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Project-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9583e85edd34e2593be56260112772e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Tenant: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Tenant-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61657]: X-User: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61657]: X-User-Id: 4a050adae85d407c8855e5c762ff5615 Apr 12 16:24:29 user devstack@n-api.service[61657]: X-User-Name: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61657]: Apr 12 16:24:29 user devstack@n-api.service[61657]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1863623530", "metadata": {"Type": "work"}}} Apr 12 16:24:29 user devstack@n-api.service[61657]: method: Apr 12 16:24:29 user devstack@n-api.service[61657]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61657]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1863623530', 'metadata': {'Type': 'work'}}}} Apr 12 16:24:29 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise error Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi '' Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 12 16:24:29 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-e1a0e252-da90-46bb-9f5f-dc41ee323906 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-e1a0e252-da90-46bb-9f5f-dc41ee323906 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017904 Apr 12 16:24:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 362/1085] 10.0.0.210 () {64 vars in 1233 bytes} [Wed Apr 12 16:24:29 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a6e34c7b-9eac-450e-b8b7-150e33a0124f tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Calling method '.version_select at 0x7fdee774a4d0>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-a6e34c7b-9eac-450e-b8b7-150e33a0124f tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] HTTP exception thrown: Volume tempest-invalid-259488120 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a6e34c7b-9eac-450e-b8b7-150e33a0124f tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Request method failure captured: Apr 12 16:24:29 user devstack@n-api.service[61658]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-259488120 HTTP/1.1 Apr 12 16:24:29 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:24:29 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:24:29 user devstack@n-api.service[61658]: Connection: close Apr 12 16:24:29 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:24:29 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:24:29 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:24:29 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:24:29 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNts9_WRt7WUY2XdO_Uorq1VdSsS6pgw3YuQfQb7HygCKYTIuaEAvJy5M5ut53mLvfJaY44wIfGMeNSBHNYY68zomb0QF59dpYTR6hZGt1x_mFtlQFLkUOsakBjxeoElCcg8rRwGM3aO7A8kEUyIfQLfl8H9g1W9c0xccCveb6eyDhh4 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9583e85edd34e2593be56260112772e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Id: 4a050adae85d407c8855e5c762ff5615 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Name: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61658]: method: Apr 12 16:24:29 user devstack@n-api.service[61658]: exception: Volume tempest-invalid-259488120 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: action_args: {'id': 'tempest-invalid-259488120'} Apr 12 16:24:29 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-259488120 could not be found. (HTTP 404) (Request-ID: req-7e6d0bc7-a7aa-4a74-95b7-1d9e75544007) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-259488120 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-259488120 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-259488120 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-a6e34c7b-9eac-450e-b8b7-150e33a0124f tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Returning 404 to user: Volume tempest-invalid-259488120 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-a6e34c7b-9eac-450e-b8b7-150e33a0124f tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-259488120" status: 404 len: 98 microversion: 2.1 time: 0.041053 Apr 12 16:24:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 365/1086] 10.0.0.210 () {62 vars in 1292 bytes} [Wed Apr 12 16:24:29 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-259488120 => generated 98 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-4c18feb1-8629-4731-82e7-24ba530871b7 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004632 Apr 12 16:24:29 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 360/1087] 10.0.0.210 () {62 vars in 1217 bytes} [Wed Apr 12 16:24:29 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-fef4b968-bdd1-4e7f-b7e5-a9032662ff96 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006107 Apr 12 16:24:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 363/1088] 10.0.0.210 () {62 vars in 1214 bytes} [Wed Apr 12 16:24:29 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-df049689-4fcc-4d18-b7af-f1729b67ee77 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Calling method '.version_select at 0x7fdee7ad5000>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-df049689-4fcc-4d18-b7af-f1729b67ee77 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] HTTP exception thrown: Volume 3562bdde-641a-46e3-a84b-dbcdd19baf90 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-df049689-4fcc-4d18-b7af-f1729b67ee77 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Request method failure captured: Apr 12 16:24:29 user devstack@n-api.service[61658]: request: DELETE /compute/v2.1/os-volumes/3562bdde-641a-46e3-a84b-dbcdd19baf90 HTTP/1.1 Apr 12 16:24:29 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:24:29 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:24:29 user devstack@n-api.service[61658]: Connection: close Apr 12 16:24:29 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:24:29 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:24:29 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:24:29 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:24:29 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNts9_WRt7WUY2XdO_Uorq1VdSsS6pgw3YuQfQb7HygCKYTIuaEAvJy5M5ut53mLvfJaY44wIfGMeNSBHNYY68zomb0QF59dpYTR6hZGt1x_mFtlQFLkUOsakBjxeoElCcg8rRwGM3aO7A8kEUyIfQLfl8H9g1W9c0xccCveb6eyDhh4 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Project-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9583e85edd34e2593be56260112772e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:29 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Id: 4a050adae85d407c8855e5c762ff5615 Apr 12 16:24:29 user devstack@n-api.service[61658]: X-User-Name: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:29 user devstack@n-api.service[61658]: method: Apr 12 16:24:29 user devstack@n-api.service[61658]: exception: Volume 3562bdde-641a-46e3-a84b-dbcdd19baf90 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: action_args: {'id': '3562bdde-641a-46e3-a84b-dbcdd19baf90'} Apr 12 16:24:29 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3562bdde-641a-46e3-a84b-dbcdd19baf90 could not be found. (HTTP 404) (Request-ID: req-59b39d36-f69c-4088-ac43-b9e944be04f0) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3562bdde-641a-46e3-a84b-dbcdd19baf90 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3562bdde-641a-46e3-a84b-dbcdd19baf90 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3562bdde-641a-46e3-a84b-dbcdd19baf90 could not be found. Apr 12 16:24:29 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:24:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-df049689-4fcc-4d18-b7af-f1729b67ee77 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Returning 404 to user: Volume 3562bdde-641a-46e3-a84b-dbcdd19baf90 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-df049689-4fcc-4d18-b7af-f1729b67ee77 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3562bdde-641a-46e3-a84b-dbcdd19baf90" status: 404 len: 109 microversion: 2.1 time: 0.035046 Apr 12 16:24:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 366/1089] 10.0.0.210 () {62 vars in 1325 bytes} [Wed Apr 12 16:24:29 2023] DELETE /compute/v2.1/os-volumes/3562bdde-641a-46e3-a84b-dbcdd19baf90 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:29 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d226ba3e-f1eb-4a58-92c7-92a6746e7561 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Calling method '.version_select at 0x7fdee78e72e0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-d226ba3e-f1eb-4a58-92c7-92a6746e7561 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] HTTP exception thrown: Volume b104806e-db5f-4112-aded-be6cfb7fc0be could not be found. Apr 12 16:24:30 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d226ba3e-f1eb-4a58-92c7-92a6746e7561 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Request method failure captured: Apr 12 16:24:30 user devstack@n-api.service[61659]: request: GET /compute/v2.1/os-volumes/b104806e-db5f-4112-aded-be6cfb7fc0be HTTP/1.1 Apr 12 16:24:30 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:24:30 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:24:30 user devstack@n-api.service[61659]: Connection: close Apr 12 16:24:30 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:24:30 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:24:30 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:24:30 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:24:30 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNts9_WRt7WUY2XdO_Uorq1VdSsS6pgw3YuQfQb7HygCKYTIuaEAvJy5M5ut53mLvfJaY44wIfGMeNSBHNYY68zomb0QF59dpYTR6hZGt1x_mFtlQFLkUOsakBjxeoElCcg8rRwGM3aO7A8kEUyIfQLfl8H9g1W9c0xccCveb6eyDhh4 Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Project-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c9583e85edd34e2593be56260112772e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c9583e85edd34e2593be56260112772e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Tenant-Id: c9583e85edd34e2593be56260112772e Apr 12 16:24:30 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesNegativeTest-2061089658 Apr 12 16:24:30 user devstack@n-api.service[61659]: X-User: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:30 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:24:30 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:24:30 user devstack@n-api.service[61659]: X-User-Id: 4a050adae85d407c8855e5c762ff5615 Apr 12 16:24:30 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesNegativeTest-2061089658-project-member Apr 12 16:24:30 user devstack@n-api.service[61659]: method: Apr 12 16:24:30 user devstack@n-api.service[61659]: exception: Volume b104806e-db5f-4112-aded-be6cfb7fc0be could not be found. Apr 12 16:24:30 user devstack@n-api.service[61659]: action_args: {'id': 'b104806e-db5f-4112-aded-be6cfb7fc0be'} Apr 12 16:24:30 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b104806e-db5f-4112-aded-be6cfb7fc0be could not be found. (HTTP 404) (Request-ID: req-fd386aed-de0a-4660-b598-c38ccab8d575) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b104806e-db5f-4112-aded-be6cfb7fc0be could not be found. Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b104806e-db5f-4112-aded-be6cfb7fc0be could not be found. Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b104806e-db5f-4112-aded-be6cfb7fc0be could not be found. Apr 12 16:24:30 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:24:30 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-d226ba3e-f1eb-4a58-92c7-92a6746e7561 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] Returning 404 to user: Volume b104806e-db5f-4112-aded-be6cfb7fc0be could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:24:30 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-d226ba3e-f1eb-4a58-92c7-92a6746e7561 tempest-VolumesNegativeTest-2061089658 tempest-VolumesNegativeTest-2061089658-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/b104806e-db5f-4112-aded-be6cfb7fc0be" status: 404 len: 109 microversion: 2.1 time: 0.168503 Apr 12 16:24:30 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 361/1090] 10.0.0.210 () {62 vars in 1322 bytes} [Wed Apr 12 16:24:29 2023] GET /compute/v2.1/os-volumes/b104806e-db5f-4112-aded-be6cfb7fc0be => generated 109 bytes in 169 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:35 user devstack@n-api.service[61657]: DEBUG nova.objects.instance [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'services' on Instance uuid 0ef81d71-afb0-4335-b60f-13071b957d08 {{(pid=61657) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:24:35 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-d986a610-3be9-4a51-84ad-3551814c3017 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08/os-volume_attachments/080c2e7c-0047-4794-90a2-ab4835def5de" status: 202 len: 0 microversion: 2.1 time: 0.177727 Apr 12 16:24:35 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 364/1091] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:24:35 2023] DELETE /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08/os-volume_attachments/080c2e7c-0047-4794-90a2-ab4835def5de => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:35 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:24:35 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-f7f02e6f-b863-4034-8ea8-d0fe50364f4d tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08" status: 204 len: 0 microversion: 2.1 time: 0.122586 Apr 12 16:24:35 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 367/1092] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:24:35 2023] DELETE /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:36 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:24:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-af6fd0b4-4088-44fb-80e0-af917cd85ed6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08" status: 200 len: 1547 microversion: 2.1 time: 0.193100 Apr 12 16:24:36 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 362/1093] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:24:35 2023] GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08 => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:37 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef81d71-afb0-4335-b60f-13071b957d08", "name": "network-vif-unplugged", "status": "completed", "tag": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:37 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] Creating event network-vif-unplugged:cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance 0ef81d71-afb0-4335-b60f-13071b957d08 on user Apr 12 16:24:37 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-c3a7d8cd-5aad-4dd5-b827-69d8db5a7471 req-86690e7c-b35d-42f3-8ba9-6774d37363e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036491 Apr 12 16:24:37 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 365/1094] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:24:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:39 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:24:39 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-38b89dfd-a4a7-46d6-9d33-11ff36ba3b20 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 200 len: 1442 microversion: 2.1 time: 0.232171 Apr 12 16:24:39 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 368/1095] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:24:39 2023] GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 1442 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:24:39 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ef81d71-afb0-4335-b60f-13071b957d08", "name": "network-vif-plugged", "status": "completed", "tag": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24"}, {"server_uuid": "0ef81d71-afb0-4335-b60f-13071b957d08", "name": "network-vif-deleted", "tag": "cb7029cd-2b2f-4e5a-8f70-5f644a14eb24"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:24:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:24:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:24:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:24:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Creating event network-vif-plugged:cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance 0ef81d71-afb0-4335-b60f-13071b957d08 on user Apr 12 16:24:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] Creating event network-vif-deleted:cb7029cd-2b2f-4e5a-8f70-5f644a14eb24 for instance 0ef81d71-afb0-4335-b60f-13071b957d08 on user Apr 12 16:24:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-f809096e-c322-4104-b0d4-558d58200fa1 req-44d3b807-ae27-4b7b-8f56-8dad6169feda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044538 Apr 12 16:24:39 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 363/1096] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:24:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:01 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:01 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:02 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995a52402acf40bf88b6c7c0440b1b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af762be84c243289780b7af16caae5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:25:02 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-41d7be16-c9ed-411a-8f7c-8e2da45c66db tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4" status: 200 len: 1486 microversion: 2.1 time: 0.259851 Apr 12 16:25:02 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 366/1097] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:25:01 2023] GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => generated 1486 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: 0ef81d71-afb0-4335-b60f-13071b957d08] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] HTTP exception thrown: Instance 0ef81d71-afb0-4335-b60f-13071b957d08 could not be found. Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Request method failure captured: Apr 12 16:25:26 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08 HTTP/1.1 Apr 12 16:25:26 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:25:26 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:25:26 user devstack@n-api.service[61658]: Connection: close Apr 12 16:25:26 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:25:26 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:25:26 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:25:26 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:25:26 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtq3PAbQz3hcu_mUlUNByUOTa1lpI7wIYFMw788waVy35lMbvqOoh18pKHslGio_g_fjR2VYHGbZ80rgzFM0aoBhq80rniqg55Qmj2QV62eIlqrTQ2rZ9DknYN-n_xAjyzojI83KVWO49snfdmQpYE7pWQ9hSBRbUadSQnvDnEtNT2g Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Project-Id: c91ef8cd37154632a031592cdc6792aa Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1094479403 Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c91ef8cd37154632a031592cdc6792aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c91ef8cd37154632a031592cdc6792aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c91ef8cd37154632a031592cdc6792aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Tenant: tempest-VolumesSnapshotTestJSON-1094479403 Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Tenant-Id: c91ef8cd37154632a031592cdc6792aa Apr 12 16:25:26 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1094479403 Apr 12 16:25:26 user devstack@n-api.service[61658]: X-User: tempest-VolumesSnapshotTestJSON-1094479403-project-member Apr 12 16:25:26 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:25:26 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:25:26 user devstack@n-api.service[61658]: X-User-Id: c9173175144449a391d282ba8978c9d9 Apr 12 16:25:26 user devstack@n-api.service[61658]: X-User-Name: tempest-VolumesSnapshotTestJSON-1094479403-project-member Apr 12 16:25:26 user devstack@n-api.service[61658]: method: > Apr 12 16:25:26 user devstack@n-api.service[61658]: exception: Instance 0ef81d71-afb0-4335-b60f-13071b957d08 could not be found. Apr 12 16:25:26 user devstack@n-api.service[61658]: action_args: {'id': '0ef81d71-afb0-4335-b60f-13071b957d08'} Apr 12 16:25:26 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ef81d71-afb0-4335-b60f-13071b957d08 could not be found. Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ef81d71-afb0-4335-b60f-13071b957d08 could not be found. Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ef81d71-afb0-4335-b60f-13071b957d08 could not be found. Apr 12 16:25:26 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:25:26 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Returning 404 to user: Instance 0ef81d71-afb0-4335-b60f-13071b957d08 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:25:26 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-ce3b9a50-013e-42b8-9a54-681c9e2717fa tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08" status: 404 len: 111 microversion: 2.1 time: 0.063854 Apr 12 16:25:26 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 369/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:25:26 2023] GET /compute/v2.1/servers/0ef81d71-afb0-4335-b60f-13071b957d08 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=8 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1016540753", "imageRef": "9dc63f14-8b70-4e72-89f2-13464f2f5c7c", "flavorRef": "42", "networks": [{"uuid": "8a87df1a-24b8-499e-a908-0d1fa99ed69a"}]}} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.network.neutron [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] validate_networks() for [('8a87df1a-24b8-499e-a908-0d1fa99ed69a', None, None, None, None, None)] {{(pid=61659) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image limits 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Flavor pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Image pref 0:0:0 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.virt.hardware [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61659) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting quotas for project c91ef8cd37154632a031592cdc6792aa. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.quota [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Getting quotas for user c9173175144449a391d282ba8978c9d9 and project c91ef8cd37154632a031592cdc6792aa. Resources: {'ram', 'cores', 'instances'} {{(pid=61659) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Going to run 1 instances... {{(pid=61659) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:25:35 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9dc63f14-8b70-4e72-89f2-13464f2f5c7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61659) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:25:36 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-5a76f749-57af-4db3-9ae5-871fa3beb8a6 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.520437 Apr 12 16:25:36 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 364/1099] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:25:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:25:36 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-2e420348-c40a-4941-8b94-794f25c5ea54 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:36 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-2e420348-c40a-4941-8b94-794f25c5ea54 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:25:36 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:36 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:36 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-2e420348-c40a-4941-8b94-794f25c5ea54 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:25:36 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-2e420348-c40a-4941-8b94-794f25c5ea54 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237" status: 200 len: 1213 microversion: 2.1 time: 0.071137 Apr 12 16:25:36 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 367/1100] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:25:36 2023] GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:38 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f31d2b1b-afbe-4fef-9ee4-f003842d5237", "tag": "ce90db7b-5efd-411b-a2f8-b7484a527704"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:38 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:38 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:25:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:38 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] Creating event network-changed:ce90db7b-5efd-411b-a2f8-b7484a527704 for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 on user Apr 12 16:25:38 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-d85673a8-3cef-409c-a5de-1d6e832273dd req-731a019d-95ba-44ce-a03d-b354c6847882 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041947 Apr 12 16:25:38 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 370/1101] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:25:38 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:39 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:25:39 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-cad9b218-ae3f-4dfa-a868-24e260d1d18f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 200 len: 1442 microversion: 2.1 time: 0.391947 Apr 12 16:25:39 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 365/1102] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:25:39 2023] GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 1442 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:40 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31d2b1b-afbe-4fef-9ee4-f003842d5237", "name": "network-vif-plugged", "status": "completed", "tag": "ce90db7b-5efd-411b-a2f8-b7484a527704"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:40 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] Creating event network-vif-plugged:ce90db7b-5efd-411b-a2f8-b7484a527704 for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 on user Apr 12 16:25:40 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a9d6e3c3-9ab9-470c-b60f-45f591c1563d req-603f174e-2ea6-47e5-b9f5-3c446c565b98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034986 Apr 12 16:25:40 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 368/1103] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:25:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31d2b1b-afbe-4fef-9ee4-f003842d5237", "name": "network-vif-plugged", "status": "completed", "tag": "ce90db7b-5efd-411b-a2f8-b7484a527704"}, {"name": "network-changed", "server_uuid": "d9a374be-4852-45e3-b346-79a08b60f981", "tag": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Creating event network-vif-plugged:ce90db7b-5efd-411b-a2f8-b7484a527704 for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 on user Apr 12 16:25:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] Creating event network-changed:aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance d9a374be-4852-45e3-b346-79a08b60f981 on user Apr 12 16:25:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-ea8d2d71-d42e-4d1d-a896-76b3646f7129 req-a6be5a4f-b8d8-4b3a-bb80-7e5760f07e44 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.044800 Apr 12 16:25:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 371/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:25:42 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:42 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Going to try to terminate instance {{(pid=61659) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:25:42 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-b97cc7b7-8540-4f46-9345-ce518d322c32 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 204 len: 0 microversion: 2.1 time: 0.132753 Apr 12 16:25:42 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 366/1105] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:25:42 2023] DELETE /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:42 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:43 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:25:43 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-51a4fd6c-8b92-46db-81d2-0c0def86674f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 200 len: 1448 microversion: 2.1 time: 0.291409 Apr 12 16:25:43 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 369/1106] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:25:42 2023] GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 1448 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:25:43 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a374be-4852-45e3-b346-79a08b60f981", "name": "network-vif-unplugged", "status": "completed", "tag": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:43 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] Creating event network-vif-unplugged:aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance d9a374be-4852-45e3-b346-79a08b60f981 on user Apr 12 16:25:43 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-05c7a860-7fbf-49a7-927b-0ca3395063d4 req-20a8360c-70da-465c-a3ba-a6de6ee551e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036397 Apr 12 16:25:43 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 372/1107] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:25:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-3b0a24de-0b37-4705-a886-5a2f8f53e95a req-6b16709b-2eae-463c-a42e-52bcef9bcbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a374be-4852-45e3-b346-79a08b60f981", "name": "network-vif-deleted", "tag": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3b0a24de-0b37-4705-a886-5a2f8f53e95a req-6b16709b-2eae-463c-a42e-52bcef9bcbfa service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3b0a24de-0b37-4705-a886-5a2f8f53e95a req-6b16709b-2eae-463c-a42e-52bcef9bcbfa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-3b0a24de-0b37-4705-a886-5a2f8f53e95a req-6b16709b-2eae-463c-a42e-52bcef9bcbfa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-3b0a24de-0b37-4705-a886-5a2f8f53e95a req-6b16709b-2eae-463c-a42e-52bcef9bcbfa service nova] Creating event network-vif-deleted:aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance d9a374be-4852-45e3-b346-79a08b60f981 on user Apr 12 16:25:45 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-3b0a24de-0b37-4705-a886-5a2f8f53e95a req-6b16709b-2eae-463c-a42e-52bcef9bcbfa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032622 Apr 12 16:25:45 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 367/1108] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:25:45 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9a374be-4852-45e3-b346-79a08b60f981", "name": "network-vif-plugged", "status": "completed", "tag": "aeffb3da-3b3c-40c0-bca4-ee483aa11e39"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:25:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:25:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:25:45 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:25:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] Creating event network-vif-plugged:aeffb3da-3b3c-40c0-bca4-ee483aa11e39 for instance d9a374be-4852-45e3-b346-79a08b60f981 on user Apr 12 16:25:45 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-f06329dd-b6e4-4838-ba1b-10e2ec8631c8 req-ef79a858-1c67-4a5c-812d-8b4b5c4c4806 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031369 Apr 12 16:25:45 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 370/1109] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:25:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:08 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:26:08 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-33f56fef-eb09-427e-afeb-8fdc74dbaa5d tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4" status: 204 len: 0 microversion: 2.1 time: 0.133208 Apr 12 16:26:08 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 373/1110] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:26:08 2023] DELETE /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell0:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:08 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=10 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=10 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:08 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b40e07a-eb45-4fe7-9f98-dc718231a4a4", "name": "network-vif-unplugged", "status": "completed", "tag": "f4ad5837-50cf-4283-aee0-7f531fb6cee6"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:08 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] Creating event network-vif-unplugged:f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 on user Apr 12 16:26:08 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-c8d72ceb-b143-41c7-9a4a-6683eb7c7d35 req-7b060f64-2813-4f8b-9a1f-f0424359c6e3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.231298 Apr 12 16:26:08 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 371/1111] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:08 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995a52402acf40bf88b6c7c0440b1b94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5af762be84c243289780b7af16caae5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:26:08 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-13063fec-3051-40c3-92b5-5b2fcca754d4 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4" status: 200 len: 1492 microversion: 2.1 time: 0.557778 Apr 12 16:26:08 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 368/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:26:08 2023] GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => generated 1492 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:10 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b40e07a-eb45-4fe7-9f98-dc718231a4a4", "name": "network-vif-plugged", "status": "completed", "tag": "f4ad5837-50cf-4283-aee0-7f531fb6cee6"}, {"server_uuid": "6b40e07a-eb45-4fe7-9f98-dc718231a4a4", "name": "network-vif-deleted", "tag": "f4ad5837-50cf-4283-aee0-7f531fb6cee6"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:10 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Creating event network-vif-plugged:f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 on user Apr 12 16:26:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] Creating event network-vif-deleted:f4ad5837-50cf-4283-aee0-7f531fb6cee6 for instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 on user Apr 12 16:26:10 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-76705270-f3a4-4776-9bfd-f03c743f7874 req-72af23f3-2235-4886-9c8e-8b620a6814f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031336 Apr 12 16:26:10 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 374/1113] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:26 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:26:26 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-dc411324-0c9d-4adb-905b-5d23855aec88 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237" status: 200 len: 1495 microversion: 2.1 time: 0.182847 Apr 12 16:26:26 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 372/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:26:26 2023] GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237 => generated 1495 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:26:33 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 HTTP/1.1 Apr 12 16:26:33 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:26:33 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:26:33 user devstack@n-api.service[61659]: Connection: close Apr 12 16:26:33 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:26:33 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:26:33 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:26:33 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:26:33 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:26:33 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:26:33 user devstack@n-api.service[61659]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:26:33 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:26:33 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:26:33 user devstack@n-api.service[61659]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:26:33 user devstack@n-api.service[61659]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:26:33 user devstack@n-api.service[61659]: method: > Apr 12 16:26:33 user devstack@n-api.service[61659]: exception: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:26:33 user devstack@n-api.service[61659]: action_args: {'id': 'd9a374be-4852-45e3-b346-79a08b60f981'} Apr 12 16:26:33 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:26:33 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:33 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:26:33 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-55e41d42-5855-489f-9ea9-4bfa5f20e3c9 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 404 len: 111 microversion: 2.1 time: 0.047399 Apr 12 16:26:33 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 369/1115] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:26:33 2023] GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1740870386", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-2081417066", "security_groups": [{"name": "tempest-secgroup-smoke-1275514734"}], "block_device_mapping_v2": [{"uuid": "7ae18173-eee9-4607-b0a7-940d48146909", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1439244b-8287-4bba-a88c-99d4b498cccd"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] validate_networks() for [('1439244b-8287-4bba-a88c-99d4b498cccd', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:26:33 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for user 7054687447fc42339e9046ced4915890 and project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:26:34 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:26:34 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7ae18173-eee9-4607-b0a7-940d48146909',volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:26:34 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-1753685d-6fcb-4f64-b492-96e19693e575 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.822100 Apr 12 16:26:34 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 375/1116] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:26:33 2023] POST /compute/v2.1/servers => generated 404 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:26:34 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-bd67e44e-a440-4e7f-ba11-8ed878984057 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:34 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-bd67e44e-a440-4e7f-ba11-8ed878984057 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:26:34 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-bd67e44e-a440-4e7f-ba11-8ed878984057 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:26:34 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-bd67e44e-a440-4e7f-ba11-8ed878984057 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5" status: 200 len: 1090 microversion: 2.1 time: 0.095103 Apr 12 16:26:34 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 373/1117] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:26:34 2023] GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5 => generated 1090 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:26:37 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:37 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] Creating event network-changed:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:26:37 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-00964457-6bea-4a18-875a-55c1cf246827 req-f235a580-e0ad-423a-81d6-6efd7d68e932 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039975 Apr 12 16:26:37 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 370/1118] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:26:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:42 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "name": "network-vif-plugged", "status": "completed", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:42 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] Creating event network-vif-plugged:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:26:42 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-7097f8c6-697a-4b01-8066-627994340331 req-b76a88da-8c18-440f-9f0b-219e0bba150b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Apr 12 16:26:42 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 376/1119] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:26:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:26:44 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "name": "network-vif-plugged", "status": "completed", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:26:44 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:44 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:44 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:44 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] Creating event network-vif-plugged:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:26:44 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-8c335daf-9d2e-4e62-ae8a-863a28c5212f req-8cdaecac-efb1-40c3-9327-e609722a7e4a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050584 Apr 12 16:26:44 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 374/1120] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:26:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] [instance: 6b40e07a-eb45-4fe7-9f98-dc718231a4a4] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:26:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] HTTP exception thrown: Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 could not be found. Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Request method failure captured: Apr 12 16:26:58 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4 HTTP/1.1 Apr 12 16:26:58 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:26:58 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:26:58 user devstack@n-api.service[61659]: Connection: close Apr 12 16:26:58 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:26:58 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:26:58 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:26:58 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:26:58 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtspEoIlSvj-r_dtVYflfvt6T_mS58JtOghGMio7zGpbX9iX9IBfIH3WY5dWk0hkJVycOBay7wZR5kFVwSGu8xmAkSuuWxvxGtz7mTvbD_ul11YBfM_bHtRyOhBiwi5hiU8Efn3ZDrNGvc6_q6RG7lCHL9lDySuX3TA0ZXU28Afe3Qo Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Project-Id: 5af762be84c243289780b7af16caae5c Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Project-Name: tempest-VolumesActionsTest-944096851 Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5af762be84c243289780b7af16caae5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5af762be84c243289780b7af16caae5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5af762be84c243289780b7af16caae5c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Tenant: tempest-VolumesActionsTest-944096851 Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Tenant-Id: 5af762be84c243289780b7af16caae5c Apr 12 16:26:58 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-VolumesActionsTest-944096851 Apr 12 16:26:58 user devstack@n-api.service[61659]: X-User: tempest-VolumesActionsTest-944096851-project-member Apr 12 16:26:58 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:26:58 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:26:58 user devstack@n-api.service[61659]: X-User-Id: 995a52402acf40bf88b6c7c0440b1b94 Apr 12 16:26:58 user devstack@n-api.service[61659]: X-User-Name: tempest-VolumesActionsTest-944096851-project-member Apr 12 16:26:58 user devstack@n-api.service[61659]: method: > Apr 12 16:26:58 user devstack@n-api.service[61659]: exception: Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 could not be found. Apr 12 16:26:58 user devstack@n-api.service[61659]: action_args: {'id': '6b40e07a-eb45-4fe7-9f98-dc718231a4a4'} Apr 12 16:26:58 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 could not be found. Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 could not be found. Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 could not be found. Apr 12 16:26:58 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:26:58 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] Returning 404 to user: Instance 6b40e07a-eb45-4fe7-9f98-dc718231a4a4 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:26:58 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-65d40c55-6489-489e-91c2-6f4ccdcd80d9 tempest-VolumesActionsTest-944096851 tempest-VolumesActionsTest-944096851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4" status: 404 len: 111 microversion: 2.1 time: 0.034236 Apr 12 16:26:58 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 371/1121] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:26:58 2023] GET /compute/v2.1/servers/6b40e07a-eb45-4fe7-9f98-dc718231a4a4 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:24 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:27:24 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-7af374fb-252b-4133-ab4f-2e5927dd154a tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5" status: 200 len: 1444 microversion: 2.1 time: 0.165477 Apr 12 16:27:24 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 377/1122] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:27:24 2023] GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5 => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db778c74-4764-46cf-9b9d-b6f3023dd52f", "device": "/dev/vdb"}} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:26 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-6cf7398f-8c5b-4738-b4b6-63f919fa764f tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761966 Apr 12 16:27:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 375/1123] 10.0.0.210 () {64 vars in 1400 bytes} [Wed Apr 12 16:27:26 2023] POST /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237/os-volume_attachments => generated 194 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=2 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:45 user devstack@n-api.service[61659]: DEBUG nova.objects.instance [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lazy-loading 'services' on Instance uuid f31d2b1b-afbe-4fef-9ee4-f003842d5237 {{(pid=61659) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 12 16:27:46 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-a10c66d7-97ed-404b-a100-0027dfa46a0e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237/os-volume_attachments/db778c74-4764-46cf-9b9d-b6f3023dd52f" status: 202 len: 0 microversion: 2.1 time: 0.175061 Apr 12 16:27:46 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 372/1124] 10.0.0.210 () {62 vars in 1493 bytes} [Wed Apr 12 16:27:45 2023] DELETE /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237/os-volume_attachments/db778c74-4764-46cf-9b9d-b6f3023dd52f => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:46 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:27:46 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-18ebb6c3-0702-4886-96a1-2bd63cc75e8e tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237" status: 204 len: 0 microversion: 2.1 time: 0.135014 Apr 12 16:27:46 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 378/1125] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:27:46 2023] DELETE /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:46 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9173175144449a391d282ba8978c9d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c91ef8cd37154632a031592cdc6792aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:27:46 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-7c4c95ba-2c44-4da9-afbd-b44cca936152 tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237" status: 200 len: 1547 microversion: 2.1 time: 0.164443 Apr 12 16:27:46 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 376/1126] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:27:46 2023] GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237 => generated 1547 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:27:47 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31d2b1b-afbe-4fef-9ee4-f003842d5237", "name": "network-vif-unplugged", "status": "completed", "tag": "ce90db7b-5efd-411b-a2f8-b7484a527704"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:47 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] Creating event network-vif-unplugged:ce90db7b-5efd-411b-a2f8-b7484a527704 for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 on user Apr 12 16:27:47 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-cee01b18-8730-43ec-813f-d233213e834d req-10091f2d-85ff-4944-b3e9-c94240fe597e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029764 Apr 12 16:27:47 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 373/1127] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:27:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:27:49 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f31d2b1b-afbe-4fef-9ee4-f003842d5237", "name": "network-vif-plugged", "status": "completed", "tag": "ce90db7b-5efd-411b-a2f8-b7484a527704"}, {"server_uuid": "f31d2b1b-afbe-4fef-9ee4-f003842d5237", "name": "network-vif-deleted", "tag": "ce90db7b-5efd-411b-a2f8-b7484a527704"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:27:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:27:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:27:49 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:27:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Creating event network-vif-plugged:ce90db7b-5efd-411b-a2f8-b7484a527704 for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 on user Apr 12 16:27:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] Creating event network-vif-deleted:ce90db7b-5efd-411b-a2f8-b7484a527704 for instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 on user Apr 12 16:27:49 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-8d8b829a-a35c-49c1-904f-a74b7a5326ed req-ebc87444-07fc-4e48-8d4d-5b4a3c10c5fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031334 Apr 12 16:27:49 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 379/1128] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:27:49 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:24 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:28:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1e2c0804-e284-4ef6-a4f3-e73d9c779f12 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5" status: 200 len: 1444 microversion: 2.1 time: 0.166101 Apr 12 16:28:24 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 377/1129] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:28:24 2023] GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5 => generated 1444 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:28:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:28:26 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:28:26 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:28:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:26 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] Creating event network-changed:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:28:26 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-58f6c2ac-cfe5-4a20-ad0c-2d534aabbbd3 req-79e5582b-7da5-4fbd-81eb-5782056cefaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317492 Apr 12 16:28:26 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 374/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:28:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:31 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-341342855", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-2081417066", "security_groups": [{"name": "tempest-secgroup-smoke-1275514734"}], "block_device_mapping_v2": [{"uuid": "9ea46a74-c4ee-408e-ace3-887f94a0e939", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1439244b-8287-4bba-a88c-99d4b498cccd"}]}} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:28:31 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:28:31 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:28:31 user devstack@n-api.service[61658]: DEBUG nova.network.neutron [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] validate_networks() for [('1439244b-8287-4bba-a88c-99d4b498cccd', None, None, None, None, None)] {{(pid=61658) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image limits 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Flavor pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Image pref 0:0:0 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.virt.hardware [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61658) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.quota [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Getting quotas for user 7054687447fc42339e9046ced4915890 and project 29b1b89a5eeb408a8d0938e5f59f405f. Resources: {'ram', 'cores', 'instances'} {{(pid=61658) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Going to run 1 instances... {{(pid=61658) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 12 16:28:32 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ea46a74-c4ee-408e-ace3-887f94a0e939',volume_size=None,volume_type=None)] {{(pid=61658) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 12 16:28:32 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-69a1fde3-83d8-450f-a3e6-31448de085a4 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.234857 Apr 12 16:28:32 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 380/1131] 10.0.0.210 () {64 vars in 1224 bytes} [Wed Apr 12 16:28:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 1237 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 12 16:28:32 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-3ecf275f-5705-4282-a917-382ef85deff6 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:32 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-3ecf275f-5705-4282-a917-382ef85deff6 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:28:32 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-3ecf275f-5705-4282-a917-382ef85deff6 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:28:32 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-3ecf275f-5705-4282-a917-382ef85deff6 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b" status: 200 len: 1089 microversion: 2.1 time: 0.067056 Apr 12 16:28:32 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 378/1132] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:28:32 2023] GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b => generated 1089 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:28:34 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:28:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:34 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:34 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] Creating event network-changed:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:28:34 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-92af2c33-7aa9-4992-8df5-0aacebab9e4b req-4942df92-82c0-4cd9-a423-28bd05f9c067 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028146 Apr 12 16:28:34 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 375/1133] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] [instance: f31d2b1b-afbe-4fef-9ee4-f003842d5237] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:36 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] HTTP exception thrown: Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 could not be found. Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Request method failure captured: Apr 12 16:28:36 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237 HTTP/1.1 Apr 12 16:28:36 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:28:36 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:28:36 user devstack@n-api.service[61658]: Connection: close Apr 12 16:28:36 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:28:36 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:28:36 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:28:36 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:28:36 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtq3PAbQz3hcu_mUlUNByUOTa1lpI7wIYFMw788waVy35lMbvqOoh18pKHslGio_g_fjR2VYHGbZ80rgzFM0aoBhq80rniqg55Qmj2QV62eIlqrTQ2rZ9DknYN-n_xAjyzojI83KVWO49snfdmQpYE7pWQ9hSBRbUadSQnvDnEtNT2g Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Project-Id: c91ef8cd37154632a031592cdc6792aa Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1094479403 Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c91ef8cd37154632a031592cdc6792aa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c91ef8cd37154632a031592cdc6792aa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c91ef8cd37154632a031592cdc6792aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Tenant: tempest-VolumesSnapshotTestJSON-1094479403 Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Tenant-Id: c91ef8cd37154632a031592cdc6792aa Apr 12 16:28:36 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1094479403 Apr 12 16:28:36 user devstack@n-api.service[61658]: X-User: tempest-VolumesSnapshotTestJSON-1094479403-project-member Apr 12 16:28:36 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:28:36 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:28:36 user devstack@n-api.service[61658]: X-User-Id: c9173175144449a391d282ba8978c9d9 Apr 12 16:28:36 user devstack@n-api.service[61658]: X-User-Name: tempest-VolumesSnapshotTestJSON-1094479403-project-member Apr 12 16:28:36 user devstack@n-api.service[61658]: method: > Apr 12 16:28:36 user devstack@n-api.service[61658]: exception: Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 could not be found. Apr 12 16:28:36 user devstack@n-api.service[61658]: action_args: {'id': 'f31d2b1b-afbe-4fef-9ee4-f003842d5237'} Apr 12 16:28:36 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 could not be found. Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 could not be found. Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 could not be found. Apr 12 16:28:36 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:28:36 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] Returning 404 to user: Instance f31d2b1b-afbe-4fef-9ee4-f003842d5237 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:28:36 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-394765af-89fc-4791-b791-75fb0815e3af tempest-VolumesSnapshotTestJSON-1094479403 tempest-VolumesSnapshotTestJSON-1094479403-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237" status: 404 len: 111 microversion: 2.1 time: 0.029652 Apr 12 16:28:36 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 381/1134] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:28:36 2023] GET /compute/v2.1/servers/f31d2b1b-afbe-4fef-9ee4-f003842d5237 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:28:41 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "name": "network-vif-plugged", "status": "completed", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:28:41 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=6 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:28:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:41 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] Creating event network-vif-plugged:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:28:41 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-959c9757-fbf9-4865-8f00-c6b1233419e2 req-bb66b58d-ee68-4d47-b0e8-4b99cd789acb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034908 Apr 12 16:28:41 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 379/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:28:43 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "name": "network-vif-plugged", "status": "completed", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:28:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:28:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:28:43 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:28:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] Creating event network-vif-plugged:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:28:43 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-bb50175a-8b68-4553-96f3-ceb8f2d7a2ac req-486917f0-d643-4b89-b2a8-468b99d082e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029146 Apr 12 16:28:43 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 376/1136] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:29:22 user devstack@n-api.service[61658]: ERROR oslo.messaging._drivers.impl_rabbit [-] [62b6f2a9-4a86-4ff4-b518-6c5ccad5402f] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell0:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=4 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:29:22 user devstack@n-api.service[61658]: DEBUG nova.policy [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61658) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:29:22 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-5fc8aa69-4ecd-4af9-b666-c43a8c388797 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b" status: 200 len: 1443 microversion: 2.1 time: 0.161157 Apr 12 16:29:22 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 382/1137] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:29:22 2023] GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b => generated 1443 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell0:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=8 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=2 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:30:22 user devstack@n-api.service[61657]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:30:22 user devstack@n-api.service[61657]: Wed Apr 12 16:30:22 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b (ip 10.0.0.210) !!! Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:22 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:23 user devstack@n-api.service[61657]: DEBUG nova.policy [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61657) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:30:23 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-77da9ec0-b34b-474d-9254-884d0a2d786b tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b" status: 200 len: 1443 microversion: 2.1 time: 0.393753 Apr 12 16:30:23 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 380/1138] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:30:22 2023] GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b => generated 1443 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:24 user devstack@n-api.service[61659]: ERROR oslo.messaging._drivers.impl_rabbit [-] [623e708f-6350-44f2-9694-6d00f8d867c0] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 16:30:24 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:30:24 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=6 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:30:24 user devstack@n-api.service[61659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:30:24 user devstack@n-api.service[61659]: Wed Apr 12 16:30:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 16:30:24 user devstack@n-api.service[61659]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 12 16:30:24 user devstack@n-api.service[61659]: Wed Apr 12 16:30:24 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 12 16:30:24 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:30:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:24 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.compute.server_external_events [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] Creating event network-changed:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:30:24 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [req-fcb1f7c2-0ed8-4903-9882-a465c1f12257 req-7a9e70d7-d081-4720-bb38-9d025eebe174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049865 Apr 12 16:30:24 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 377/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=2 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=6 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:27 user devstack@n-api.service[61658]: INFO oslo.messaging._drivers.impl_rabbit [-] [62b6f2a9-4a86-4ff4-b518-6c5ccad5402f] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34706. Apr 12 16:30:27 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] Creating event network-changed:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:30:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-880b9243-3ebe-4345-ab78-bdd1a69fbe9c req-676edbd8-7031-4194-b86c-d15e9e2fdc57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134516 Apr 12 16:30:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 381/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:30:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:30:27 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-2649d3f1-47d8-45bd-af40-01d660de4046 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b" status: 204 len: 0 microversion: 2.1 time: 0.218298 Apr 12 16:30:27 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 383/1141] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:30:27 2023] DELETE /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:30:27 user devstack@n-api.service[61659]: INFO oslo.messaging._drivers.impl_rabbit [-] [623e708f-6350-44f2-9694-6d00f8d867c0] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 34718. Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "name": "network-vif-unplugged", "status": "completed", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:27 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] Creating event network-vif-unplugged:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:30:27 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-218d89ae-279f-4869-91cd-7f31e60f442c req-1b8455ee-f534-48ba-9900-47d290275390 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032851 Apr 12 16:30:27 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 382/1142] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:30:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:30:27 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:30:27 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-54e50312-a4c4-4be8-93b5-b299eebe20d3 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b" status: 200 len: 1567 microversion: 2.1 time: 0.464026 Apr 12 16:30:27 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 378/1143] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:30:27 2023] GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b => generated 1567 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:30:29 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-b0421556-e2fb-494b-9e27-28a0eaedcc0f req-9d94cf4b-bccf-4cb2-babf-35f3a3cc7074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "name": "network-vif-deleted", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:30:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b0421556-e2fb-494b-9e27-28a0eaedcc0f req-9d94cf4b-bccf-4cb2-babf-35f3a3cc7074 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b0421556-e2fb-494b-9e27-28a0eaedcc0f req-9d94cf4b-bccf-4cb2-babf-35f3a3cc7074 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:29 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-b0421556-e2fb-494b-9e27-28a0eaedcc0f req-9d94cf4b-bccf-4cb2-babf-35f3a3cc7074 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-b0421556-e2fb-494b-9e27-28a0eaedcc0f req-9d94cf4b-bccf-4cb2-babf-35f3a3cc7074 service nova] Creating event network-vif-deleted:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:30:29 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-b0421556-e2fb-494b-9e27-28a0eaedcc0f req-9d94cf4b-bccf-4cb2-babf-35f3a3cc7074 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034639 Apr 12 16:30:29 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 384/1144] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:30:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 12 16:30:29 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34545689-e52e-428b-9106-550d3cd7536b", "name": "network-vif-plugged", "status": "completed", "tag": "96ff73b8-4a94-433c-ab04-02d046ea5cfb"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:30:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:30:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:30:29 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:30:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] Creating event network-vif-plugged:96ff73b8-4a94-433c-ab04-02d046ea5cfb for instance 34545689-e52e-428b-9106-550d3cd7536b on user Apr 12 16:30:29 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-bc8f9621-2d62-4eb7-b36e-55305bc02f10 req-fc995310-93dd-48e4-adbb-2b32432b850e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030630 Apr 12 16:30:29 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 383/1145] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:30:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:31:17 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:31:17 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=8 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 34545689-e52e-428b-9106-550d3cd7536b] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance 34545689-e52e-428b-9106-550d3cd7536b could not be found. Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:31:18 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b HTTP/1.1 Apr 12 16:31:18 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:31:18 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:31:18 user devstack@n-api.service[61659]: Connection: close Apr 12 16:31:18 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:31:18 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:31:18 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:31:18 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:31:18 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:31:18 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:31:18 user devstack@n-api.service[61659]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:31:18 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:31:18 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:31:18 user devstack@n-api.service[61659]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:31:18 user devstack@n-api.service[61659]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:31:18 user devstack@n-api.service[61659]: method: > Apr 12 16:31:18 user devstack@n-api.service[61659]: exception: Instance 34545689-e52e-428b-9106-550d3cd7536b could not be found. Apr 12 16:31:18 user devstack@n-api.service[61659]: action_args: {'id': '34545689-e52e-428b-9106-550d3cd7536b'} Apr 12 16:31:18 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34545689-e52e-428b-9106-550d3cd7536b could not be found. Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34545689-e52e-428b-9106-550d3cd7536b could not be found. Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34545689-e52e-428b-9106-550d3cd7536b could not be found. Apr 12 16:31:18 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:31:18 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance 34545689-e52e-428b-9106-550d3cd7536b could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:31:18 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c384c75d-ac32-4ec5-8d75-b5104826c43c tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b" status: 404 len: 111 microversion: 2.1 time: 0.218815 Apr 12 16:31:18 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 379/1146] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:31:17 2023] GET /compute/v2.1/servers/34545689-e52e-428b-9106-550d3cd7536b => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:31:23 user devstack@n-api.service[61657]: ERROR oslo.messaging._drivers.impl_rabbit [-] [86d11961-6d11-42a3-b58c-4a4e0048de64] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 12 16:31:23 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=8 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:31:23 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=12 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:31:23 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:23 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:23 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] Creating event network-changed:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:31:23 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-a48edd92-60b1-4c63-bdc7-8e497c84c6ae req-6daef12d-3bb7-4790-b782-8b58707dc4aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040727 Apr 12 16:31:23 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 384/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:31:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:31:23 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Going to try to terminate instance {{(pid=61658) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 12 16:31:23 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-06e69e2a-b3aa-45a3-b2b5-0ff4745c1473 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5" status: 204 len: 0 microversion: 2.1 time: 0.139849 Apr 12 16:31:23 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 385/1148] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:31:22 2023] DELETE /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:23 user devstack@n-api.service[61659]: DEBUG nova.policy [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7054687447fc42339e9046ced4915890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29b1b89a5eeb408a8d0938e5f59f405f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61659) authorize /opt/stack/nova/nova/policy.py:203}} Apr 12 16:31:23 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-012dbf5e-dbfb-48b4-80cd-f7f8af90988e tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5" status: 200 len: 1569 microversion: 2.1 time: 0.203892 Apr 12 16:31:23 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 380/1149] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:31:23 2023] GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 12 16:31:24 user devstack@n-api.service[61657]: INFO oslo.messaging._drivers.impl_rabbit [-] [86d11961-6d11-42a3-b58c-4a4e0048de64] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 37208. Apr 12 16:31:24 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [req-7fc549c9-73f9-4719-a2e9-111238fa580f req-d24d955c-7a6b-4b4e-832b-cef3aba5a0ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "name": "network-vif-deleted", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}]} {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:31:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7fc549c9-73f9-4719-a2e9-111238fa580f req-d24d955c-7a6b-4b4e-832b-cef3aba5a0ee service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7fc549c9-73f9-4719-a2e9-111238fa580f req-d24d955c-7a6b-4b4e-832b-cef3aba5a0ee service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:24 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [req-7fc549c9-73f9-4719-a2e9-111238fa580f req-d24d955c-7a6b-4b4e-832b-cef3aba5a0ee service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.compute.server_external_events [req-7fc549c9-73f9-4719-a2e9-111238fa580f req-d24d955c-7a6b-4b4e-832b-cef3aba5a0ee service nova] Creating event network-vif-deleted:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:31:24 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [req-7fc549c9-73f9-4719-a2e9-111238fa580f req-d24d955c-7a6b-4b4e-832b-cef3aba5a0ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083370 Apr 12 16:31:24 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 385/1150] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:31:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:31:25 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "name": "network-vif-unplugged", "status": "completed", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}, {"server_uuid": "2c01f491-2979-40d7-b74e-f580009309c5", "name": "network-vif-plugged", "status": "completed", "tag": "88022433-f52e-45f9-80a5-b93ca88aa273"}]} {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 12 16:31:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:31:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:31:25 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:31:25 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Creating event network-vif-unplugged:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:31:25 user devstack@n-api.service[61658]: INFO nova.api.openstack.compute.server_external_events [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] Creating event network-vif-plugged:88022433-f52e-45f9-80a5-b93ca88aa273 for instance 2c01f491-2979-40d7-b74e-f580009309c5 on user Apr 12 16:31:25 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [req-1a838430-9e1e-4b52-87c0-7eec5912b9ff req-a392781c-f3a1-4601-895c-e0b7ac7cd563 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.035435 Apr 12 16:31:25 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 386/1151] 10.0.0.210 () {68 vars in 1394 bytes} [Wed Apr 12 16:31:25 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_api:SELECT=4 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG dbcounter [-] [61659] Writing DB stats nova_cell1:SELECT=8 {{(pid=61659) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG nova.compute.api [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: 2c01f491-2979-40d7-b74e-f580009309c5] Fetching instance by UUID {{(pid=61659) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG oslo_concurrency.lockutils [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61659) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:32:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.wsgi [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance 2c01f491-2979-40d7-b74e-f580009309c5 could not be found. Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:32:13 user devstack@n-api.service[61659]: request: GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5 HTTP/1.1 Apr 12 16:32:13 user devstack@n-api.service[61659]: Accept: application/json Apr 12 16:32:13 user devstack@n-api.service[61659]: Accept-Encoding: identity Apr 12 16:32:13 user devstack@n-api.service[61659]: Connection: close Apr 12 16:32:13 user devstack@n-api.service[61659]: Content-Length: 0 Apr 12 16:32:13 user devstack@n-api.service[61659]: Content-Type: application/json Apr 12 16:32:13 user devstack@n-api.service[61659]: Host: 10.0.0.210 Apr 12 16:32:13 user devstack@n-api.service[61659]: Openstack-System-Scope: None Apr 12 16:32:13 user devstack@n-api.service[61659]: User-Agent: python-urllib3/1.26.15 Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Domain-Id: None Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Domain-Name: None Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Identity-Status: Confirmed Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Is-Admin-Project: True Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Project-Domain-Id: default Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Project-Domain-Name: Default Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Role: member,reader Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Roles: member,reader Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:32:13 user devstack@n-api.service[61659]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:13 user devstack@n-api.service[61659]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:32:13 user devstack@n-api.service[61659]: X-User-Domain-Id: default Apr 12 16:32:13 user devstack@n-api.service[61659]: X-User-Domain-Name: Default Apr 12 16:32:13 user devstack@n-api.service[61659]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:32:13 user devstack@n-api.service[61659]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:32:13 user devstack@n-api.service[61659]: method: > Apr 12 16:32:13 user devstack@n-api.service[61659]: exception: Instance 2c01f491-2979-40d7-b74e-f580009309c5 could not be found. Apr 12 16:32:13 user devstack@n-api.service[61659]: action_args: {'id': '2c01f491-2979-40d7-b74e-f580009309c5'} Apr 12 16:32:13 user devstack@n-api.service[61659]: {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c01f491-2979-40d7-b74e-f580009309c5 could not be found. Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c01f491-2979-40d7-b74e-f580009309c5 could not be found. Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c01f491-2979-40d7-b74e-f580009309c5 could not be found. Apr 12 16:32:13 user devstack@n-api.service[61659]: ERROR nova.api.openstack.wsgi Apr 12 16:32:13 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance 2c01f491-2979-40d7-b74e-f580009309c5 could not be found. {{(pid=61659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:32:13 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-c897ac35-4e0a-4109-926b-976ee137172f tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5" status: 404 len: 111 microversion: 2.1 time: 0.036347 Apr 12 16:32:13 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 381/1152] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:32:13 2023] GET /compute/v2.1/servers/2c01f491-2979-40d7-b74e-f580009309c5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:32:13 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_api:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG dbcounter [-] [61657] Writing DB stats nova_cell1:SELECT=4 {{(pid=61657) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG nova.compute.api [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61657) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG oslo_concurrency.lockutils [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61657) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:32:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.wsgi [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:32:14 user devstack@n-api.service[61657]: request: DELETE /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 HTTP/1.1 Apr 12 16:32:14 user devstack@n-api.service[61657]: Accept: application/json Apr 12 16:32:14 user devstack@n-api.service[61657]: Accept-Encoding: identity Apr 12 16:32:14 user devstack@n-api.service[61657]: Connection: close Apr 12 16:32:14 user devstack@n-api.service[61657]: Content-Length: 0 Apr 12 16:32:14 user devstack@n-api.service[61657]: Content-Type: application/json Apr 12 16:32:14 user devstack@n-api.service[61657]: Host: 10.0.0.210 Apr 12 16:32:14 user devstack@n-api.service[61657]: Openstack-System-Scope: None Apr 12 16:32:14 user devstack@n-api.service[61657]: User-Agent: python-urllib3/1.26.15 Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Domain-Id: None Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Domain-Name: None Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Identity-Status: Confirmed Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Is-Admin-Project: True Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Project-Domain-Id: default Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Project-Domain-Name: Default Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Role: member,reader Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Roles: member,reader Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:32:14 user devstack@n-api.service[61657]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:14 user devstack@n-api.service[61657]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:32:14 user devstack@n-api.service[61657]: X-User-Domain-Id: default Apr 12 16:32:14 user devstack@n-api.service[61657]: X-User-Domain-Name: Default Apr 12 16:32:14 user devstack@n-api.service[61657]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:32:14 user devstack@n-api.service[61657]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:32:14 user devstack@n-api.service[61657]: method: > Apr 12 16:32:14 user devstack@n-api.service[61657]: exception: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61657]: action_args: {'id': 'd9a374be-4852-45e3-b346-79a08b60f981'} Apr 12 16:32:14 user devstack@n-api.service[61657]: {{(pid=61657) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61657]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61657]: DEBUG nova.api.openstack.wsgi [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. {{(pid=61657) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:32:14 user devstack@n-api.service[61657]: INFO nova.api.openstack.requestlog [None req-1e1b9bf6-9eb8-4637-9f82-78c5cdcc9c65 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 404 len: 111 microversion: 2.1 time: 0.035321 Apr 12 16:32:14 user devstack@n-api.service[61657]: [pid: 61657|app: 0|req: 386/1153] 10.0.0.210 () {62 vars in 1316 bytes} [Wed Apr 12 16:32:13 2023] DELETE /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG dbcounter [-] [61658] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61658) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '>' {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG nova.compute.api [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] [instance: d9a374be-4852-45e3-b346-79a08b60f981] Fetching instance by UUID {{(pid=61658) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Acquiring lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG oslo_concurrency.lockutils [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Lock "dbea3ab3-8640-46e2-9e3e-8e9284315861" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61658) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 12 16:32:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.wsgi [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] HTTP exception thrown: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Request method failure captured: Apr 12 16:32:14 user devstack@n-api.service[61658]: request: GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 HTTP/1.1 Apr 12 16:32:14 user devstack@n-api.service[61658]: Accept: application/json Apr 12 16:32:14 user devstack@n-api.service[61658]: Accept-Encoding: identity Apr 12 16:32:14 user devstack@n-api.service[61658]: Connection: close Apr 12 16:32:14 user devstack@n-api.service[61658]: Content-Length: 0 Apr 12 16:32:14 user devstack@n-api.service[61658]: Content-Type: application/json Apr 12 16:32:14 user devstack@n-api.service[61658]: Host: 10.0.0.210 Apr 12 16:32:14 user devstack@n-api.service[61658]: Openstack-System-Scope: None Apr 12 16:32:14 user devstack@n-api.service[61658]: User-Agent: python-urllib3/1.26.15 Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Auth-Token: gAAAAABkNtkQivqhUkxxmMHN2RIf9GhRP6aHBL1wrnuYLJRk8oZnpn1L9EZOkYkocXtFpKQVXynwjHPrRThuasNA41s11vJyoawxgrT4Wf5CX9FDCp5fXeSSwwVYWpD5WWTAf0vP2BRrltgsImM1-PEraIAkHw9uRZHkZYEU3E_-FfpaiNJQCCE Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Domain-Id: None Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Domain-Name: None Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Identity-Status: Confirmed Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Is-Admin-Project: True Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Project-Domain-Id: default Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Project-Domain-Name: Default Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Project-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Project-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Role: member,reader Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Roles: member,reader Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29b1b89a5eeb408a8d0938e5f59f405f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Tenant: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Tenant-Id: 29b1b89a5eeb408a8d0938e5f59f405f Apr 12 16:32:14 user devstack@n-api.service[61658]: X-Tenant-Name: tempest-TestVolumeBootPattern-734600841 Apr 12 16:32:14 user devstack@n-api.service[61658]: X-User: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:32:14 user devstack@n-api.service[61658]: X-User-Domain-Id: default Apr 12 16:32:14 user devstack@n-api.service[61658]: X-User-Domain-Name: Default Apr 12 16:32:14 user devstack@n-api.service[61658]: X-User-Id: 7054687447fc42339e9046ced4915890 Apr 12 16:32:14 user devstack@n-api.service[61658]: X-User-Name: tempest-TestVolumeBootPattern-734600841-project-member Apr 12 16:32:14 user devstack@n-api.service[61658]: method: > Apr 12 16:32:14 user devstack@n-api.service[61658]: exception: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61658]: action_args: {'id': 'd9a374be-4852-45e3-b346-79a08b60f981'} Apr 12 16:32:14 user devstack@n-api.service[61658]: {{(pid=61658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. Apr 12 16:32:14 user devstack@n-api.service[61658]: ERROR nova.api.openstack.wsgi Apr 12 16:32:14 user devstack@n-api.service[61658]: DEBUG nova.api.openstack.wsgi [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Returning 404 to user: Instance d9a374be-4852-45e3-b346-79a08b60f981 could not be found. {{(pid=61658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 12 16:32:14 user devstack@n-api.service[61658]: INFO nova.api.openstack.requestlog [None req-c00f5f99-69d2-4b08-9be4-6ba489cc99a5 tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981" status: 404 len: 111 microversion: 2.1 time: 0.042377 Apr 12 16:32:14 user devstack@n-api.service[61658]: [pid: 61658|app: 0|req: 387/1154] 10.0.0.210 () {62 vars in 1313 bytes} [Wed Apr 12 16:32:14 2023] GET /compute/v2.1/servers/d9a374be-4852-45e3-b346-79a08b60f981 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 12 16:32:16 user devstack@n-api.service[61659]: DEBUG nova.api.openstack.wsgi [None req-2f4ae578-3cfc-4005-8147-58fa9084d1fd tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] Calling method '.version_select at 0x7fdee756dab0>' {{(pid=61659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 12 16:32:16 user devstack@n-api.service[61659]: INFO nova.api.openstack.requestlog [None req-2f4ae578-3cfc-4005-8147-58fa9084d1fd tempest-TestVolumeBootPattern-734600841 tempest-TestVolumeBootPattern-734600841-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2081417066" status: 202 len: 0 microversion: 2.1 time: 0.042174 Apr 12 16:32:16 user devstack@n-api.service[61659]: [pid: 61659|app: 0|req: 382/1155] 10.0.0.210 () {62 vars in 1340 bytes} [Wed Apr 12 16:32:16 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2081417066 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)